-- Logs begin at Mon 2022-08-22 11:52:02 UTC, end at Mon 2022-08-22 13:07:57 UTC. -- Aug 22 12:25:30.716960 dv-cinder-850836-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 12:25:30.724508 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 12:25:30 2022] *** Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: nodename: dv-cinder-850836-6-iscsi Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: machine: x86_64 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: clock source: unix Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: pcre jit disabled Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: detected number of CPU cores: 4 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: current working directory: / Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: detected binary path: /usr/bin/uwsgi-core Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: your processes number limit is 47680 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: your memory page size is 4096 bytes Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: detected max file descriptor number: 2048 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: lock engine: pthread robust mutexes Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: thunder lock: enabled Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 12:25:30.730980 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 12:25:30.767747 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: Python main interpreter initialized at 0x55e04c81b9c0 Aug 22 12:25:30.767747 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: python threads support enabled Aug 22 12:25:30.767747 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: your server socket listen backlog is limited to 100 connections Aug 22 12:25:30.767747 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: your mercy for graceful operations on workers is 90 seconds Aug 22 12:25:30.768082 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 12:25:30.768180 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: *** Operational MODE: preforking *** Aug 22 12:25:30.768461 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: *** uWSGI is running in multiple interpreter mode *** Aug 22 12:25:30.768461 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: spawned uWSGI master process (pid: 81880) Aug 22 12:25:30.768712 dv-cinder-850836-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 22 12:25:30.770884 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: spawned uWSGI worker 1 (pid: 81881, cores: 1) Aug 22 12:25:30.770884 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: spawned uWSGI worker 2 (pid: 81882, cores: 1) Aug 22 12:25:30.770884 dv-cinder-850836-6-iscsi devstack@keystone.service[81880]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 12:25:35.021742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:35.021742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: from cryptography.utils import int_from_bytes Aug 22 12:25:35.022567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:35.022567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: from cryptography.utils import int_from_bytes Aug 22 12:25:35.022984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:35.022984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: from cryptography.utils import int_from_bytes Aug 22 12:25:35.023091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 12:25:35.023091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: from cryptography.utils import int_from_bytes Aug 22 12:25:35.071772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:25:35.071967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:25:35.072073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 12:25:35.072165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] command line args: [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:25:35.072243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 12:25:35.072403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:25:35.072493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] command line args: [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 12:25:35.072576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ================================================================================ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:25:35.072678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 12:25:35.072817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] admin_token = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.072896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ================================================================================ {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 12:25:35.073064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] config_dir = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] admin_token = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] config_dir = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] config_source = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] debug = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] config_source = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.073774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] debug = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.074924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_config_append = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_config_append = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_dir = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.075912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_dir = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_file = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.076921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.077934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.078960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.079927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] publish_errors = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] publish_errors = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.080940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.081564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.081652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.081768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] standard_threads = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.081850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] standard_threads = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] use_journal = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] use_json = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] use_journal = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.082977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] use_stderr = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] use_json = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] use_syslog = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] use_stderr = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] use_syslog = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.083641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 12:25:35.083793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.083872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.084851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.085965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.086935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.087985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.088949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.089914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.090875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.091955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.092982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.093979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.094929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.095924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.096935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.097967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.098925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.099970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.100904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.101959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.102957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.103989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.104923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.105983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.106941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.107984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.external = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.external = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.108966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.password = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.token = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.password = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] auth.token = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.109868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.110991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.111948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.112529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.112719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.112800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.112959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.113917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.114960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.115997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.116958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.117909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.118888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.119981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.120934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.121956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.122967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.123910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.124997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.125937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.126990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.127709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.128951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.129893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.130864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.131833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.132867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.133950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.134923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.135952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.136887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.137839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.138984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.139999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.140960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.141910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] role.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] role.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.142873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] role.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] role.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.143863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.144996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.145948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.146919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.147904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.148863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.149963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.150933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.151948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.152908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.153859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.154979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.155845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.connection = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.156944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.157963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.158919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.159942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:25:35.160016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 12:25:35.160172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 12:25:35.189108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.189334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.189420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.189563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.189650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.189855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.197807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.198493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.226607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.226837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.227121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.227355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.279527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.279812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.327667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.327893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.329208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.329447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.483664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.483866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.483954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.484823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.507742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.507969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.508974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.509057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.509184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.509396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.519875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.520320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.532471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.532651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.532737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.532872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.532958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.533807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.534492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81881) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 12:25:35.550676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.550883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.551221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.551418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.551689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.552746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.552746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.552746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.559627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.559838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.560176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.560376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 12:25:35.560650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.560908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.561419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.561677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.561910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.562201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.562481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.562760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.570165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.571560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.571837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.572106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.572385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.573055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.573337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.573618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.573901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.574200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.574467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.574739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.575957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.579589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.583092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.583376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.583658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.583938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.584243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.584501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.584768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.585038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.585440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.585718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.585984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.599069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.600527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.600809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.605442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.605727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.606008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.608772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.610250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.610532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.612341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.612649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.615405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.615688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.615971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.616762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.617053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.617333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.617608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.617876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.618145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.618438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.618704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.622273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.622558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.626667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.626955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.627234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.627542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.628401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.628679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.628945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.636099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.636393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.640226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.643991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.644287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.646981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.647266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.648531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.651270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.651685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.654468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.654763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.654920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.655218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.655505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.655790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.656069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.656355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.659027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.662313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.665637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.665934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.666304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.666590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.666869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.667153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.672023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.672320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.672585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.672889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.679725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.681241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.681525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.683516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.683805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.684079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.684178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.684343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.684429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.684701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.684993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.685268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.691862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.693377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.693652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.696353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.696636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.696925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.697087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.697225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.697368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.697499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.697643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.697916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.698205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.698553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.698844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.709949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.710250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.710529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.710805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.711083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.711370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.711651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.714872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.717873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.720782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.722273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.723733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.724014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.724306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.727117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.730117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.730732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.732182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.732998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.734477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.735094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.735380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.735661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.735937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.736022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.736218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.736511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.743149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.743846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.744135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.744412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.751696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.751696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.751696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.751696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.751696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.752093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.752093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.752093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.752093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.752363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.752559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.753355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.753622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.753890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.754197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.754480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.754741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.755010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.755264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.756714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.757011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.757285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.764152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81881) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 12:25:35.764432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.764707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.764979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.765248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.765525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.765793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.766055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.766358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.766646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.766915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.767176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.767447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.767701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81881) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 12:25:35.789662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e04c81b9c0 pid: 81882 (default app) Aug 22 12:25:35.793061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5c4d-3b4c-4ab0-93e0-3d8226a64d3f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:35.797409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5c4d-3b4c-4ab0-93e0-3d8226a64d3f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:35.797409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5c4d-3b4c-4ab0-93e0-3d8226a64d3f None None] PATH_INFO: `/v3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:35.797701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Mon Aug 22 12:25:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:35.802452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e04c81b9c0 pid: 81881 (default app) Aug 22 12:25:43.406958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:43.407483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:43.407483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:43.409396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:43.418114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:43.418561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:43.418695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:43.488353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: INFO dbcounter [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] Registered counter for database keystone Aug 22 12:25:43.508910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG oslo_db.sqlalchemy.engines [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:25:43.515276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writer thread running {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:25:43.711313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG passlib.handlers.bcrypt [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81881) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 12:25:43.711663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG passlib.handlers.bcrypt [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81881) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 12:25:43.766240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:43.767835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:43.894658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 12:25:44.200386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:44.268630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: INFO dbcounter [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] Registered counter for database keystone Aug 22 12:25:44.287927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG oslo_db.sqlalchemy.engines [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 12:25:44.294240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writer thread running {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 12:25:44.412953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0554-f41a-4701-9a0f-447e340617bc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:44.417293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:44.417921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:44.418221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:44.418501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:44.427079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:44.479782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING keystone.common.rbac_enforcer.enforcer [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 12:25:44.480071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91809bd9-62fd-4dbb-be53-699a04b863ab admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:44.489893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Aug 22 12:25:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 12:25:44.495852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:44.511071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23208d44-2db6-4b80-96de-bd57d97a8d9a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:44.515516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:44.516634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:44.516914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:44.517191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] PATH_INFO: `/v3/projects/2da9e1885c75493abe2144dd979376b4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:44.519345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] RBAC: Authorizing `identity:get_project(project_id=2da9e1885c75493abe2144dd979376b4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:44.574930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 12:25:44.575280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef19f59-98e2-48d2-a736-41364a14e39e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:44.581637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 2/5] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Aug 22 12:25:44 2022] GET /identity/v3/projects/2da9e1885c75493abe2144dd979376b4 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:46.450113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac9cb-38ae-438f-82be-827210363e55 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.450672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac9cb-38ae-438f-82be-827210363e55 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.450769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac9cb-38ae-438f-82be-827210363e55 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.455108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 4/6] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:46.460900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.461302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.461474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.481532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:46.483097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:46.491038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 12:25:46.764754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac9cb-38ae-438f-82be-827210363e55 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:46.777401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac9cb-38ae-438f-82be-827210363e55 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:46.781597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:46.782213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.782498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.782770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.790411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:46.792177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b432c-46cf-4614-9073-442ebd6a6899 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:46.800820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Aug 22 12:25:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:25:46.805953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:46.815519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68792e-a773-4674-ba23-a3c036c12a81 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:46.819841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:46.820462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:46.820742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:46.821018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:46.822356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:46.824159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b152ce-c129-4209-a506-d7d26fce67e8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:46.825659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 4/9] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Aug 22 12:25:46 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:48.784760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ff11-0c90-4365-838d-5c5c06fb0f81 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.785268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ff11-0c90-4365-838d-5c5c06fb0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.785268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ff11-0c90-4365-838d-5c5c06fb0f81 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.786827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:48.791820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591749-d8f0-4336-bfae-1c2d5a6014ca None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.792253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591749-d8f0-4336-bfae-1c2d5a6014ca None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.792505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591749-d8f0-4336-bfae-1c2d5a6014ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.810542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c9591749-d8f0-4336-bfae-1c2d5a6014ca None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:48.811718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c9591749-d8f0-4336-bfae-1c2d5a6014ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:48.891032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:48.895166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f8c9-2415-415a-a7eb-53e1873b3e31 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.895455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f8c9-2415-415a-a7eb-53e1873b3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.895731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94f8c9-2415-415a-a7eb-53e1873b3e31 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.897024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 7/12] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:48.902160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:48.902478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:48.902759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:48.920177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:48.921356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:48.938079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:48.991602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:49.159533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94f8c9-2415-415a-a7eb-53e1873b3e31 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.260867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.302821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94f8c9-2415-415a-a7eb-53e1873b3e31 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.337136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.337988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.338305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.338582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.350385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:49.359103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:49.360025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:25:49.360815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 8/14] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:25:49.362628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24586370-e6d4-42d0-93d8-9d1480d3c6c4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.368139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.396958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.397595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.397862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.398141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.403873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.419735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.465540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.467038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.473976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8bf39-e567-4bf3-93ed-3a7faebbf3fc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.507969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.508577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.508856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.509133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.509793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:49.510095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.511525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.523685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 9/15] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.529359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.565468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 7/16] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:25:49.571010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.621648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.622372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.628116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0a225-27b4-429b-bc33-18fd991dde76 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.661597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.662246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.662522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.662792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.664342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.665917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.667481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839808-2efe-4667-9b4a-f8bc88370265 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.667587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 10/17] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.673189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.702521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.703147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.703425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.703696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.713683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.715153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:25:49.733083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:49.733974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:25:49.734980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:25:49.734980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:49.734980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:25:49.734980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 8/18] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:25:49.740417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.774448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c520f21-578c-438d-b876-25b093bf9eb2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.807774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.808382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.808657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.808922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.810121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.811599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.813135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 11/19] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.819528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:49.840669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01d3f-8c69-44be-a028-00f7725946c8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.843002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.851626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:49.872956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.873555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.873828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.874094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.874810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:49.875104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.876470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e346468-eb87-46ba-8a44-7683122752dd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.895106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 9/20] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:49.920390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede1b8f-74c4-4d28-96fd-d3cef37285dd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:49.959032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:49.959562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:49.959835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:49.960105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:49.960831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.domain.id=default, user.id=eb451a0ed5164dd0a6301058cedf4d62) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:49.961138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:49.962649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d5818-2c77-43be-9d89-7e91b3e41850 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:49.972317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 12/21] 10.222.0.15 () {56 vars in 1322 bytes} [Mon Aug 22 12:25:49 2022] GET /identity/v3/role_assignments?user.id=eb451a0ed5164dd0a6301058cedf4d62&scope.domain.id=default&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:52.105734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328595-ad51-4f73-bf17-140da7913c51 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.106754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328595-ad51-4f73-bf17-140da7913c51 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.107258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328595-ad51-4f73-bf17-140da7913c51 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.108810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 10/22] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:52.114316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.114717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.114889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.137434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG passlib.handlers.bcrypt [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81882) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 12:25:52.137856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG passlib.handlers.bcrypt [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81882) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 12:25:52.195252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.196831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-01d4f56f-e7be-45e9-8a7b-2f48c18df52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.243348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b2518-0645-4b46-9606-98164b198a6f None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.243979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b2518-0645-4b46-9606-98164b198a6f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.244451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b2518-0645-4b46-9606-98164b198a6f None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.245965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 11/23] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:52.255468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.256019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.256504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.303962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 13/24] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:52.306457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.307961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.366605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828804-8791-46eb-9d80-6f8a076a0aea None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.366886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828804-8791-46eb-9d80-6f8a076a0aea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.367073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828804-8791-46eb-9d80-6f8a076a0aea None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.368661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 14/25] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:52.379442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.379970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.380474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.416972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:52.418162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:52.422350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:52.450554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:52.512778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:25:52.633996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:52.742058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:52.749151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793232c-3401-4de4-8691-6d8bd65d87fb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:52.785097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:52.785744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:52.786021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:52.786327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:52.798222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:52.804593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:52.805442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:25:52.806235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 13/28] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:25:52.815808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:52.822114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:52.962940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa59c-9df1-4819-a403-285f675d2624 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:52.967086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cd51e-aa2f-4303-899d-6fa399d3ff6f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.017930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.018601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.018881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.019156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.019815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:53.020118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.021226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.021611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b272222-7579-494d-ba75-1066476c2085 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.022253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.022712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.023216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.030248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 16/29] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.031572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0803e-f49b-472c-baa5-0198c5c6a580 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.032012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0803e-f49b-472c-baa5-0198c5c6a580 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.032426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0803e-f49b-472c-baa5-0198c5c6a580 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.034339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 17/30] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:53.036476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0803e-f49b-472c-baa5-0198c5c6a580 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.040117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.041808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.056684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:25:53.062918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:53.063758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:25:53.064552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:25:53.064552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:25:53.064552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:25:53.066872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 14/31] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:25:53.068035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.084371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.159256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0803e-f49b-472c-baa5-0198c5c6a580 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.184744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381834b9-bc19-48ae-90e2-c8dee27dc1f4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.201541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.202641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.203190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.203661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.204526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.208232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.237589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.237589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.237589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.237589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1fb1-1b80-4ab0-ba72-b7bd754940a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 15/32] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.237942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.261195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:53.262805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:53.340643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 16/33] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:53.341486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.355402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.438115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 18/34] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/roles => generated 219 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:53.444050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.588793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.600655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d85373-7a2a-46d6-a327-d9e1139b6ee6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.615813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d480-886f-4d5d-b5ce-3cef05d8b9a6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.665120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.665810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.666090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.666399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.669294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.673858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.675946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 19/35] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.683480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.691110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.691730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.692005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.692530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.693138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:53.695084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.695841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9666f8-f454-4162-86b9-879a5c9a786a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.714627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 17/36] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:53.723867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2ec9b-d853-420c-9762-e2d0322fca74 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.724237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2ec9b-d853-420c-9762-e2d0322fca74 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.724585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2ec9b-d853-420c-9762-e2d0322fca74 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.726470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:53.727089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2ec9b-d853-420c-9762-e2d0322fca74 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:53.824350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.835264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3f431-c99f-4449-bd8d-df76ce34a2b2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.874404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.875063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.875297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.875579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] PATH_INFO: `/v3/domains/default/users/eb451a0ed5164dd0a6301058cedf4d62/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.876739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2ec9b-d853-420c-9762-e2d0322fca74 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:53.877939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb451a0ed5164dd0a6301058cedf4d62, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.879541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88918c42-661a-4177-8b3e-416d086a11f8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.910736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:53.911343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.911619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.911886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.912513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:53.913941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e8d27-fdea-463f-a1e9-c3b256f90fd1 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:53.967585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 20/38] 10.222.0.15 () {58 vars in 1361 bytes} [Mon Aug 22 12:25:53 2022] PUT /identity/v3/domains/default/users/eb451a0ed5164dd0a6301058cedf4d62/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:25:53.969039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:53.969329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:53.969609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:53.983233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:53.990117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:53.995240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:54.066269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:54.071747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.196096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff3d91-d1ff-43d5-90e2-fa419bf24049 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.215023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:25:53 2022] POST /identity/v3/projects => generated 301 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:54.216613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279f1b-d987-422d-bd16-4c53bdb27b08 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.216908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279f1b-d987-422d-bd16-4c53bdb27b08 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.217192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279f1b-d987-422d-bd16-4c53bdb27b08 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.218451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 20/41] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:54.226999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.227496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.228007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.238028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.238850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.239238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.239618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.240412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.241983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.246963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.250657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:54.253246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:54.339707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:54.340373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.370251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:25:54.499422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606356d-56a2-4fab-92a5-d345865669ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.539248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.539874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.540155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.540430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.541096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.542514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.652079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.675454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/roles => generated 223 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:54.712205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.772771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedbda7-22ec-4794-ad65-aed3ab73c7b6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.809349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.809998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.810310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.810588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.811735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.813376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bdcf2-8afa-4f11-a993-e3d817191ffd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:54.815783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 22/45] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:54.821304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:54.882939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:54.926701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427d0f-6b57-42db-b332-81193bd5355d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:54.960891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:54.961494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:54.961774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:54.962047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:54.962720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:54.964162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db8d06-c422-4877-a015-4368f95fce37 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:55.068536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:25:54 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:25:55.981700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52ec23-ad72-4115-b74c-ddea2b4d3074 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:55.982238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52ec23-ad72-4115-b74c-ddea2b4d3074 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:55.982348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52ec23-ad72-4115-b74c-ddea2b4d3074 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:55.983607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:55.989023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:55.989414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:55.989572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.007722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:56.008888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:56.073965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:25:56.348672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52ec23-ad72-4115-b74c-ddea2b4d3074 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:56.447223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52ec23-ad72-4115-b74c-ddea2b4d3074 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:56.461652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:56.484901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:56.485533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.485809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.486080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.497894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:25:56.503620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:25:56.504481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:25:56.505226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 24/49] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:25:56.510682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:56.548922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:56.607082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450680dc-5969-4e3a-bb8f-1a336ea5c942 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:56.640147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:56.640753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.641031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.641304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.641956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:56.642280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:56.643694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:56.651906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 26/50] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:56.657530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:56.775383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62613c65-4a98-442f-83d8-4cb19edb2e75 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:56.809701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:56.810309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.810594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.810874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.812011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:56.813477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:56.816059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:25:56.821743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:56.923092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:56.926745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2cb02-4a87-4f40-a3e3-31721d0c1426 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:56.960862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:56.961501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:56.961785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:56.962060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:56.963224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:56.964696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd636f37-ca3f-43a8-a83f-ca816fadaf7d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:56.966306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:56.972645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.001054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb42-7d47-455e-a9f2-d5f9634b0f52 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.001524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb42-7d47-455e-a9f2-d5f9634b0f52 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.001619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06afb42-7d47-455e-a9f2-d5f9634b0f52 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.003044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 28/53] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:25:57.007872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.008165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.008447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.016075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.026737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:57.027943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:57.074010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2975-a889-49d0-9d6b-24cecd1510fa None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.096017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:25:57.108836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.109445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.109726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.110002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.110752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.domain.id=default, user.id=eb451a0ed5164dd0a6301058cedf4d62) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:25:57.111059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.112742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.119788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1322 bytes} [Mon Aug 22 12:25:56 2022] GET /identity/v3/role_assignments?user.id=eb451a0ed5164dd0a6301058cedf4d62&scope.domain.id=default&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:57.365951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.574471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.578346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559268c-257c-47dc-9daf-bc96bdef2b35 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.611081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.611697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.612515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.612793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.613885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.615358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca5f8-0a38-4ec0-a26c-cdb3ba74fae2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.616946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:25:57.622571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:25:57.717853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feccf0-c9b5-4d9a-8be8-f58e03d830cb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:25:57.725477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:25:57.750227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ab556-6d67-418a-90ec-647048065351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:25:57.750818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab556-6d67-418a-90ec-647048065351 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:57.751098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab556-6d67-418a-90ec-647048065351 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:57.751370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ab556-6d67-418a-90ec-647048065351 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:57.752005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ab556-6d67-418a-90ec-647048065351 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:25:57.753481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ab556-6d67-418a-90ec-647048065351 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:25:57.844981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 27/57] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Aug 22 12:25:57 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:25:59.733789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c7b2-31da-4da7-b34d-4883b23627f1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:59.734295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c7b2-31da-4da7-b34d-4883b23627f1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:59.734295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39c7b2-31da-4da7-b34d-4883b23627f1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:59.735678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:25:59.740933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:25:59.741352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:25:59.741476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:25:59.759544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:25:59.760711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:25:59.824560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:00.104918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39c7b2-31da-4da7-b34d-4883b23627f1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:00.208186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39c7b2-31da-4da7-b34d-4883b23627f1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:00.241842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:00.242461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:00.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:00.243015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:00.244134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:00.245571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903064d3-8fe9-46da-a07a-d59c002f7e7e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:00.247174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:00.253802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:00.340251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:00.351794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0485ec8-6e4b-4e12-9ffc-37f72549693e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:00.385262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:00.385805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:00.386082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:00.386379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:00.387022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:00.388561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2290b9-8bd1-47eb-8416-4a197be8afdd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:00.553090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:00 2022] POST /identity/v3/users => generated 275 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:03.563231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc905a-d3a6-4ad9-a607-fbe9a117d293 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.564219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc905a-d3a6-4ad9-a607-fbe9a117d293 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.564724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc905a-d3a6-4ad9-a607-fbe9a117d293 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.566978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:03.572724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587a2a-4b04-4a19-b7c0-989d83f4f75f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.573581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587a2a-4b04-4a19-b7c0-989d83f4f75f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.574063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587a2a-4b04-4a19-b7c0-989d83f4f75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.601579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b5587a2a-4b04-4a19-b7c0-989d83f4f75f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.603209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b5587a2a-4b04-4a19-b7c0-989d83f4f75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:03.672028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:03.681542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500b47-61f1-4a90-bc63-17ea33f1052a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.682133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500b47-61f1-4a90-bc63-17ea33f1052a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.682639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500b47-61f1-4a90-bc63-17ea33f1052a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.684197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 34/64] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:03.689426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.689717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.690121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.707058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f5b5-277a-4710-9ccb-98a3c37f7b13 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.707684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f5b5-277a-4710-9ccb-98a3c37f7b13 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.708173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f5b5-277a-4710-9ccb-98a3c37f7b13 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.709627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 35/65] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:03.714946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:03.715471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:03.715966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:03.717459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.718679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:03.735100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:03.736611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:03.781462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:03.825109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 36/66] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:03.853407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 31/67] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:03.988125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.092507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fde3a-9b1a-4690-9640-0d224cf9dff8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.128305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.129289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.129821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.130314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.140946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.146037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.146905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:04.147678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:04.149846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 37/68] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.155746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.160210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.212449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.243856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.290673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecbff0-1c91-4ef4-b63c-c032b6df587e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.327833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.328928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.329522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.329897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.330941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.331658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.333329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5cbe3-bc6a-4fc1-8f05-24bd9e10e455 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.334132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b8ee2-49ea-4c93-ad66-d4bf0562789c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.348678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 32/69] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.354237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55c01-a7c8-403e-a6f0-88c7b5d6cb28 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.354525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55c01-a7c8-403e-a6f0-88c7b5d6cb28 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.354800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55c01-a7c8-403e-a6f0-88c7b5d6cb28 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.356011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 33/70] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:04.356701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae55c01-a7c8-403e-a6f0-88c7b5d6cb28 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.373870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.374538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.374821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.375094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.385330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6fb7c81b-65d9-48b7-be6b-97837addfe16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.390209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.391211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:04.391983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 38/71] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:04.395412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7925-77c2-42af-b19f-6175fff1e35e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.395698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7925-77c2-42af-b19f-6175fff1e35e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.395977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7925-77c2-42af-b19f-6175fff1e35e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.397334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 39/72] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:04.399037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7925-77c2-42af-b19f-6175fff1e35e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.423201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.459298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae55c01-a7c8-403e-a6f0-88c7b5d6cb28 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.485376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.491590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.497997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.497997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.497997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.501556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7925-77c2-42af-b19f-6175fff1e35e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.503003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-6e39d058-30bd-41a3-bf45-c0a61816bedb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:04.508094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:04.508991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 34/73] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:04.514559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710c39-9a49-47f7-a9f3-102147991896 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.515320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710c39-9a49-47f7-a9f3-102147991896 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.515320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c710c39-9a49-47f7-a9f3-102147991896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.528639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2c710c39-9a49-47f7-a9f3-102147991896 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:04.529820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2c710c39-9a49-47f7-a9f3-102147991896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:04.536411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.537041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.537320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.537599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.552414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.553949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.555592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 40/74] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.556358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.601245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 35/75] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:04.602813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.603187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.603534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.620614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:04.621790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:04.654170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6f4aa-6714-49fb-90aa-2cb569f4d495 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.671905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.689063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 36/76] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:04.690208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.699211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.699954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.700309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.700661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.701777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.702425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.704248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.720257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 41/77] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.720257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.728612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.805201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303134-be85-4e23-a211-ffc0ef63ad78 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.843549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.844449 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.844935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.845383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.846303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:04.846812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.848388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.849397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e335e59-f4ba-4d45-92e2-64d41a8d26ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.862102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 37/78] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:04.863255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:04.889584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:04.890222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:04.890503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:04.890776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:04.914680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:04.966458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:04.967949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:04.968779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a099a2-2c0e-4b55-a49a-af5634eff5ed None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:04.970548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.003089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.003723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.004008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.004280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.005424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.006908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.008650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.009485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.074352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 42/80] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:05.075197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.113011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bca0-eeff-421f-b377-55bfc3dffd38 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.130098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.147076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.147700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.148848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.148848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.149415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.150894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.152452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.155357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.172788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42472ac-75b2-4fb8-b134-3bf540213181 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.175787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.207510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.208139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.208424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.208699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.219088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:05.224342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:05.225188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:05.225936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:05.226697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.254478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08cf6-4c77-4f2f-a41d-10f20370038d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.288371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.289003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.289282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.289557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.290688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.292121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.293673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 40/83] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.294549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.333670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010031b-d572-4de0-841b-9a1cb637e801 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.348222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.370643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.370643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.370643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.370643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.398600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e52a-d924-42fe-b1f9-b0b729dd0f30 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.406856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.431849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.432532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.432817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.433087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.434205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.435812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.437645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 41/84] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.438251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.449457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.450958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.535687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7e6c7-6658-4dc9-88ff-94dc9b032299 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.555184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 44/85] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:05.555184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.559416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.572971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.573584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.573868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.574149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.611318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.642679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.644140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.649223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9081ab-1036-46c5-ad70-a05086137875 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.684505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.685109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.685371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.685637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.686317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:05.686618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.687968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.696409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 45/86] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.698286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.746652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:05.747698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.768991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.796354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e722c70-97c5-452b-8d06-d4e710dfef7a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.821295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:05.830013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.830656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.830937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.831216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.831869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.833394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.848184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bca2fe-0d11-4f0c-98e1-2c86ecf0e7e9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:05.881694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:05.882332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:05.882631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:05.882906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:05.883618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:05.883923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:05.885422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:05.890667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:05.891999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.913640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 46/89] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:05 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:05.914838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:05.997953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.016800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b73e-9ca5-4783-83d9-91a753b9e1f5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.040485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d789f-9f9a-4e1c-97f5-a618b53db19f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.058962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.059652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.060088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.060301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.062235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.063450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.071104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 44/90] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.071104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.095027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.096955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.096955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.096955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.100567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.100567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.101806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 47/91] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:05 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.102691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.164449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.192684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aeede-b6de-4cce-826d-ffd913d48e88 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.226625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a22fb-a929-4d14-9f4b-97f1ae4ebad8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.241162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.242118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.242572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.242924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.244566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.246096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.248325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 45/92] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.249131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.276708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.277307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.277882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.278485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.278773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.279673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:06.279991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.282132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.292521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 48/93] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.292521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584116b3-3826-415e-8c1a-2eaf74710c24 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.423921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.425207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.425709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.426119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.441175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93322d-dfbe-4a41-b3d9-82e718fca7e3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.477049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.526287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.527267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.527543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.527814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.528541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=eb451a0ed5164dd0a6301058cedf4d62) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:06.528850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.530373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.538523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 49/94] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=eb451a0ed5164dd0a6301058cedf4d62&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.560831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.562635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.591704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:06.712844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 46/95] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:06.718668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:06.899175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cc284-4b00-4529-bd14-7c0a8f2f603d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:06.943768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:06.944407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:06.944687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:06.944957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] PATH_INFO: `/v3/projects/abcc1554da1e4256814652000900678a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:06.946072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] RBAC: Authorizing `identity:get_project(project_id=abcc1554da1e4256814652000900678a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:06.947570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde749e-fab7-41fb-9b94-850991db9e9f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:06.949372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 50/96] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/projects/abcc1554da1e4256814652000900678a => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:06.956045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:07.108963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec5e38-bf28-4658-b59f-bac674ececea None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:07.154589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:07.171292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:07.171915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:07.172199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:07.172475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:07.173203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=abcc1554da1e4256814652000900678a, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:07.173510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:07.175082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ae395-41fa-48bd-b8d8-b1fff9409995 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:07.186271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 47/97] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:06 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=abcc1554da1e4256814652000900678a&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:08.468736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03d2d-7a49-4bd4-bcd3-e057eb54c92e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.469233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03d2d-7a49-4bd4-bcd3-e057eb54c92e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.469304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c03d2d-7a49-4bd4-bcd3-e057eb54c92e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.470859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 51/98] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:08.476523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1401-2388-46c7-9ef8-51cafc878136 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.476947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1401-2388-46c7-9ef8-51cafc878136 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.477112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1401-2388-46c7-9ef8-51cafc878136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.500776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e20c1401-2388-46c7-9ef8-51cafc878136 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:08.502025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e20c1401-2388-46c7-9ef8-51cafc878136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:08.589062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:08.741973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec67b3-b084-4ed6-994e-6aed2e9d0ac9 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.742320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec67b3-b084-4ed6-994e-6aed2e9d0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.742569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec67b3-b084-4ed6-994e-6aed2e9d0ac9 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.743925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 52/100] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:08.749236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648a4f1-5e99-45f4-b0ed-de3da5216349 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:08.749530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648a4f1-5e99-45f4-b0ed-de3da5216349 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:08.749811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648a4f1-5e99-45f4-b0ed-de3da5216349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:08.775145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d648a4f1-5e99-45f4-b0ed-de3da5216349 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:08.776365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d648a4f1-5e99-45f4-b0ed-de3da5216349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:08.876691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:09.008954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025e6a-251a-43b4-99c7-3349cad3bd90 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.009287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025e6a-251a-43b4-99c7-3349cad3bd90 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.009511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025e6a-251a-43b4-99c7-3349cad3bd90 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.010896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 53/102] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:09.018867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.019158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.019442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.047177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:09.048352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:09.048834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025e6a-251a-43b4-99c7-3349cad3bd90 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.111612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.168170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 50/103] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:09.175065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.247450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025e6a-251a-43b4-99c7-3349cad3bd90 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.299064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.299763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.300040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.300311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.322886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:09.328452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:09.329289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:09.330039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 54/104] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:09.337580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.354424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.470166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a90930-7494-4f13-8edd-d48ad0293669 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.479422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.510379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.512367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.512853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.513318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.531465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:09.542217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:09.543082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:09.543874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:09.544451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adb281-13bd-46e9-ba0b-70f79c548f54 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.546651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 55/105] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:09.552552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.582204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.582204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.582204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.582204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.582590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:09.582590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.582590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f812c-f17a-483c-98d0-93215c0d8cc4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:09.591017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 51/106] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:09.592239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b21f-bf2b-42f0-a565-654c3bad4bb9 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.592531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b21f-bf2b-42f0-a565-654c3bad4bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.592807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63b21f-bf2b-42f0-a565-654c3bad4bb9 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.594022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 52/107] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:09.595235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00242fa-c9d6-43d3-8c90-d6235d25ceec None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.595701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00242fa-c9d6-43d3-8c90-d6235d25ceec None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.596645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00242fa-c9d6-43d3-8c90-d6235d25ceec None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.598290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 53/108] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:09.601193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00242fa-c9d6-43d3-8c90-d6235d25ceec None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.650488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.669053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e120a5-8c9d-4345-8397-c43415d739a8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.704789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.705429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.705714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.705994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.706689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:09.706997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.708393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909061e4-b029-4ba3-9193-e585c79fd46e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:09.716786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 56/109] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:09.721469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.721469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.721469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.725189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00242fa-c9d6-43d3-8c90-d6235d25ceec None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.736278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:09.738091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:09.761765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.770094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.770763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.771073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.775208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.775208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:09.775208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2a0e0-898e-4a6f-bfbb-11656c2fbb30 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:09.776696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 54/110] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:09.777663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.777944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.778250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:09.796503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:09.797684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:09.816334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 57/111] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:09.823059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.878554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 55/112] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:09.879530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:09.946220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fb62c-b836-4c64-86a2-3ae5832f12b9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:09.980810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:09.988153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:09.989092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:09.989589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:09.990061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.002291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:10.008536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:10.009380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:10.010254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:10.012967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:10.014156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.037418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.116148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e8e5c-071b-4d38-ac0e-07fcb6b77aea None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.139415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444b07-f2fc-4605-9bce-5de4f74dee6b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.151942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.152580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.152860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.153133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] PATH_INFO: `/v3/users/f07825b7f93d4149a12a15071e2609e3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.168106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] RBAC: Authorizing `identity:get_user(user_id=f07825b7f93d4149a12a15071e2609e3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.169572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.171652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:09 2022] GET /identity/v3/users/f07825b7f93d4149a12a15071e2609e3 => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.172743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.186749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.187419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.187707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.188002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.189154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.190682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.192451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 59/115] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.193074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.270250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.278736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df1f63-8c29-4028-ade7-7abaacaa6e6a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.282541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.300710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f020d0-32ff-4d9f-b535-f888a5095f08 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.313158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.313760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.314039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.314339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.315039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:10.315336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.316794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.324411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 57/116] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.325199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.338640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.339267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.339543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.339815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.340914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.342378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5537-7199-4854-86ae-7e0778820a75 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.343921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 60/117] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.349910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4697d-d65f-4eaa-b8f6-eba96792d649 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.350220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4697d-d65f-4eaa-b8f6-eba96792d649 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.350506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4697d-d65f-4eaa-b8f6-eba96792d649 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.351750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 61/118] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:10.352437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4697d-d65f-4eaa-b8f6-eba96792d649 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.422268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a38-c4cf-4179-a211-a1926db71cf0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.457987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.458623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.458902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.459173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.462514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4697d-d65f-4eaa-b8f6-eba96792d649 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.489893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.511589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.512266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.512546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.512819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/6ef852dc81de44be839e711a9b299cf9/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.517858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, user_id=6ef852dc81de44be839e711a9b299cf9, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.519574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.557789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.559357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.581492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 62/119] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:10 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/6ef852dc81de44be839e711a9b299cf9/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:10.582351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.599419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.679986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 58/120] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:10.680959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.705022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbac3f-3f92-457e-85f8-f7ccdac68d31 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.752897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.753545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.753695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.753871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.754093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.765460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:10.770567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:10.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:10.772660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 63/121] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:10.773314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:10.807912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d181-c551-45de-823e-71cbfe32b580 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.848486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.849397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.849690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.849942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.851121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.852568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615265a-f8b2-4c20-ba09-67a50e15201f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.854157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 59/122] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:10.858349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.858349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.858349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.859317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:10.884454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:10.885739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:10.891428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4914-cad4-4b90-9536-04a0bc3f23a2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:10.929076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:10.929691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:10.929970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:10.930603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:10.930910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:10.932361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:10.959245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 60/123] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:10.966148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.022213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 64/124] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:26:10 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:11.023632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.036287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.161151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17770d-b2fa-4641-a7ca-4cea8eb69cbc None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.168582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666910-e141-404b-8aa1-12d47061f927 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.199321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.210693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.218984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.226005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 65/125] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.227683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.251284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.252244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.252638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.252918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.254091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.255574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.263023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 61/126] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:10 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.263023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.359805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc971-9b6a-402b-adca-97eecc427902 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.398480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b973c-80c1-4276-baca-127d809ca7e0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.409516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.411039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.411681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.412144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.414247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.419454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.421384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 66/127] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.422377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.428218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.451937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.453374 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.453757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.454135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.456650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.462329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 62/128] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.467650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.499755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.560627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11a18-01f0-4d66-83e8-2bdcbecea8af None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.583325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c557dc-5112-4078-b2f5-75e43b27c29d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.608361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.609738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.610498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.610968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.621513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.622450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.622729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.623001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.623734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=f07825b7f93d4149a12a15071e2609e3) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:11.624042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.625496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.629482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:11.632834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 63/129] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/role_assignments?user.id=f07825b7f93d4149a12a15071e2609e3&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.633819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:11.634788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:11.635630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:11.636391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 67/130] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:11.637027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.766034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535b2b6-b498-48fe-a05a-b09d098a2030 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.793148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.802930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:11.814076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.815397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.815680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.815952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.817689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.819179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.820876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 68/131] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:11.821643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:11.871115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528220d-a8d3-4301-aec3-b474ffd0ac66 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:11.914550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:11.915218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:11.915498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:11.915770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/6ef852dc81de44be839e711a9b299cf9/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:11.924788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, user_id=6ef852dc81de44be839e711a9b299cf9, role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:11.926261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:11.983536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36238c57-b23c-491e-bb3e-33a6eb3ab1ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.019685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.020229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.020513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.020791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.021468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:12.021762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.023169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.032696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 64/132] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:11 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/6ef852dc81de44be839e711a9b299cf9/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.033510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.049038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 69/133] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:12.055259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.167253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.249290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c79-a0d8-4d13-bd1b-7281121c83ec None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.249501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd926c0e-d2f3-4dbb-8dc2-0f5496678b0f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.266075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.294603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.296145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.296575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.297081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/eb451a0ed5164dd0a6301058cedf4d62/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.302930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.303572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.303852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.304097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, user_id=eb451a0ed5164dd0a6301058cedf4d62, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.304213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.305310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.306111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.314302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.314302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 70/134] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:12 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:12.314302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.394753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 65/135] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:12 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/eb451a0ed5164dd0a6301058cedf4d62/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.453770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8de316-1495-4b87-875e-600d3867cd42 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.477024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:12.504928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.505588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.505867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.506139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] PATH_INFO: `/v3/projects/abcc1554da1e4256814652000900678a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.510938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] RBAC: Authorizing `identity:get_project(project_id=abcc1554da1e4256814652000900678a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.512473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134062ed-0eeb-4531-b69c-b0b6f24671f1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.514161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 71/136] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:12 2022] GET /identity/v3/projects/abcc1554da1e4256814652000900678a => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:12.520126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:12.654774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9a51b-ab87-4e09-af8f-ed20e93e8039 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:12.695397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:12.696510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.696999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.697483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] PATH_INFO: `/v3/projects/abcc1554da1e4256814652000900678a/users/6ef852dc81de44be839e711a9b299cf9/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.703760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=abcc1554da1e4256814652000900678a, user_id=6ef852dc81de44be839e711a9b299cf9, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:12.705973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0787963-cf16-411d-ba44-f5c8d88e42d5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:12.779164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 66/137] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:12 2022] PUT /identity/v3/projects/abcc1554da1e4256814652000900678a/users/6ef852dc81de44be839e711a9b299cf9/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:12.930878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca976c57-efab-4eee-96f9-3db1c07ecde5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.931365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca976c57-efab-4eee-96f9-3db1c07ecde5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.931365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca976c57-efab-4eee-96f9-3db1c07ecde5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.932681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 72/138] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:12.938796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d772a8-54f7-447c-ba32-843ece4e38c1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:12.939094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d772a8-54f7-447c-ba32-843ece4e38c1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:12.939376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d772a8-54f7-447c-ba32-843ece4e38c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:12.964021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-56d772a8-54f7-447c-ba32-843ece4e38c1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:12.965273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-56d772a8-54f7-447c-ba32-843ece4e38c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:12.994397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:13.049118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:13.599043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca976c57-efab-4eee-96f9-3db1c07ecde5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:13.654578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fa89-8bfd-4d35-9f94-dd1e351a1204 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.655263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fa89-8bfd-4d35-9f94-dd1e351a1204 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.656161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8fa89-8bfd-4d35-9f94-dd1e351a1204 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.657711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 68/140] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:13.662935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.663464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.663953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.683948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:13.685476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:13.723086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca976c57-efab-4eee-96f9-3db1c07ecde5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:13.759480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:13.760113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.760390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.760657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.771211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:13.776794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:13.777637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:13.778509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 73/141] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:13.789078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:13.858329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:13.872291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 69/142] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:13.913918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4954-38ca-42b7-856a-f30aca330d9d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:13.950818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:13.951446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:13.951684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:13.951950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:13.952856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:13.953151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:13.954559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:13.963301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 74/143] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:13.968682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.109677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.118453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a85e4-49c1-49ba-974b-bd19210edead None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.166881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.167532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.167819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.168101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.169271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.170750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6207-ee86-4403-a5f3-09d3413f2a63 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.172684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 70/144] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:13 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:14.178933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.300239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9588160-780e-4096-bb8d-16cb966228f3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.313967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.324469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa724502-36e9-48c1-9069-01c0677bcaa6 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.324750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa724502-36e9-48c1-9069-01c0677bcaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.325035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa724502-36e9-48c1-9069-01c0677bcaa6 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.330286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 71/145] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:14.337426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.338358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.338816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.339325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.339425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.339697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.339981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.396449 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:14.397577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:14.411045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.412547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.521171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 75/146] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:14.521865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.525664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.536316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 72/147] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:14.537740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.635169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750546fa-358b-4c96-bc6e-0abd47f76dd5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.674736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.675291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.675570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.675843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.677379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.678880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.680672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 76/148] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:14.686031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.764742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.778204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:14.785042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501981-be8d-4a06-b04e-65fda91dcd6d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.796511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc73d-18bb-4369-808e-c4bffa2efb7f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:14.843167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.844121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.844575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.844887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:14.845022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.845663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.846638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:14.847116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:14.847592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:14.847700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.854869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:14.856563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:14.858469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 73/149] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:14.864610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:14.955538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 77/150] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:14 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:15.024813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.050772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705389-8226-4aea-9e6d-d9d0d40fdd35 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.123009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.123880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.124299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.124737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.125622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:15.126076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.127769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69052653-c7de-4b99-9fb9-18d001ccd25d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.141058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 74/151] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:14 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.142562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e08-a702-441e-a0e8-d0c6c78b5361 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.142844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e08-a702-441e-a0e8-d0c6c78b5361 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.143652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b66e08-a702-441e-a0e8-d0c6c78b5361 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.144909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 75/152] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:15.163140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.163440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.163689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.171303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebe65-cf32-4976-9042-1b43ff9accd1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.203548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.203774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:15.204851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:15.220055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.220055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.220055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.220055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.234499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:15.240644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:15.241738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:15.242741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:15.247648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 78/153] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:15.250274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.259028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.330688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 76/154] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:15.383952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9dc52-c205-45d4-90c4-79779e4e2875 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.419432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.420094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.420374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.420647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.421312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:15.421612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.423034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075c2f-4258-4777-88d4-70d052904b12 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.432030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 79/155] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.437665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.549290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c6304-3816-4867-a2d0-749fde45aafc None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.556036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117929-6650-41f7-ac01-d22a638eb4ea None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.556310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117929-6650-41f7-ac01-d22a638eb4ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.556704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13117929-6650-41f7-ac01-d22a638eb4ea None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.558431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 80/156] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:15.563808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.564140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.564357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.591181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:15.592372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:15.594002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.594783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.595064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.595435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] PATH_INFO: `/v3/users/f07825b7f93d4149a12a15071e2609e3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.597532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] RBAC: Authorizing `identity:get_user(user_id=f07825b7f93d4149a12a15071e2609e3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.599078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.600693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 77/157] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/users/f07825b7f93d4149a12a15071e2609e3 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.606416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.635380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.657471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.689193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 81/158] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:15.722154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.731485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934834b6-0e02-4edc-8136-b51e7ef295db None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.791134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.791959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.792126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.792270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.794585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:15.796028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:15.797663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 78/159] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:15.822634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.889219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95793c64-5529-4181-be3c-7f1cc72614a4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:15.926845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:15.927952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.928423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.928931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.944512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f8dd0bcf-2076-4957-bb3c-56dbc2a4db7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:15.950879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:15.951746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:15.952835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 82/160] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:15.953486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96979-5ca6-468d-83db-9a239520b45c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:15.954295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96979-5ca6-468d-83db-9a239520b45c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:15.954295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96979-5ca6-468d-83db-9a239520b45c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:15.955275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 83/161] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:15.958972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:15.961128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96979-5ca6-468d-83db-9a239520b45c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:15.979112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993a318-1b51-4e05-b2a6-db8a661318fb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.020880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.029003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.029958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.030436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.030921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/f07825b7f93d4149a12a15071e2609e3/roles/fdcd71013b374d5bbfc7e20344176cf1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.033310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, user_id=f07825b7f93d4149a12a15071e2609e3, role_id=fdcd71013b374d5bbfc7e20344176cf1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.035597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53422dd-8087-4920-8263-4e922853f744 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.091955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96979-5ca6-468d-83db-9a239520b45c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.116606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 79/162] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:15 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/users/f07825b7f93d4149a12a15071e2609e3/roles/fdcd71013b374d5bbfc7e20344176cf1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:26:16.118345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.118858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.119327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.141343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:16.143148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:16.149581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.150238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.150503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.150775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.151458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:16.151752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.153182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.173750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 84/163] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:16.174584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.227691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 80/164] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:16.228968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.371773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.398233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b3e70-3b8a-45b4-bef8-cc33e26c9190 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.459772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.460420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.460696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.460967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.462097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.463738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.464350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656c4e-ff6a-4fee-8ead-0cb4179ff29e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.470626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.472696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 81/165] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:16.479842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.553285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.553935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.554229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.554504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.579207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:16.585079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:16.586003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:16.586812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:16.591879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 85/166] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:16.599023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.700747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8f03-2819-4568-9a71-0368186c70c3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.761538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.762560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.763033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.763497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.780300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:16.838539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.840825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.851577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911d01-caa9-4a2b-8e1e-de34b3a8e794 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:16.954354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:16.954898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:16.955178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:16.955507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:16.956678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:16.957010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:16.958772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:16.965977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 82/167] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:16.967082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:16.977557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 86/168] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:16.978503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.016916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.043274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.078040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10ed4a-dd22-435c-b241-f7735bbf8ef6 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.116452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.117126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.117398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.117662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.129184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:17.135173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:17.136139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 83/169] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:17.137309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.236410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bd25-be45-42b1-840f-dd8ca362d335 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.243791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456bf96-9491-44b6-b4c4-8b47fbfa159d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.251049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.292859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.293732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.294243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.295675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] PATH_INFO: `/v3/users/eb451a0ed5164dd0a6301058cedf4d62` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.297009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] RBAC: Authorizing `identity:get_user(user_id=eb451a0ed5164dd0a6301058cedf4d62)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.298638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.300415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/users/eb451a0ed5164dd0a6301058cedf4d62 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.301319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.355639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.356118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.356590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.357028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.363353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.365172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.367660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 87/171] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:16 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.368826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.409952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739fd3-d884-43f1-81e4-0a3849effb64 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.446032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.446933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.447353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.447766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.448575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:17.449012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.450542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.460503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 85/172] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.461488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.492244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.498364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.501673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afcf2-b99c-498f-96d8-6e089f105ebc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.538722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.539341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.539620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.540057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.568029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aaa6e-bacd-4655-8a63-465416d27d02 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.603931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.604757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.605199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.605607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.606506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:17.606947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.608572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.614702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 86/173] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.615632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.616285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.617829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.723562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.726990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504883-4c54-4846-a122-94057546f5e7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.727132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:17.737241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 88/174] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:17.744438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.798422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.799076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.799421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.799690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] PATH_INFO: `/v3/users/6ef852dc81de44be839e711a9b299cf9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.807106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=6ef852dc81de44be839e711a9b299cf9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.808618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.810417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 87/175] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/users/6ef852dc81de44be839e711a9b299cf9 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.832668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:17.909091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12172-6653-413c-8623-ea9dc8f8c6c8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:17.949551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:17.950754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:17.951300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:17.951765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:17.953518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:17.955758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:17.959703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 89/176] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:17.968022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.059682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.080331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b4-d8f3-4b23-a0d3-f0363f9fc6f2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.110799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606b782-611e-4c4c-97db-7813edb46201 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.156860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.157481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.157806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.158094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.167150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=eb451a0ed5164dd0a6301058cedf4d62) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:18.167578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.169078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.176388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.177061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 90/177] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/role_assignments?user.id=eb451a0ed5164dd0a6301058cedf4d62&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.177171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.177352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.177631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.272298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.338114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.339571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6443e-adfb-4734-84f3-79f2cbc77cb3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.478950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 88/178] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:18.484446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.485173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04435e-4bb0-4ab7-91f7-4c0934e1e503 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.485656 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04435e-4bb0-4ab7-91f7-4c0934e1e503 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.486121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04435e-4bb0-4ab7-91f7-4c0934e1e503 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.488186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 89/179] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:18.493575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.494086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.494710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.519310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:18.521240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.646630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.654359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:18.684610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c494852-e7a0-423e-8fb6-6bc45bd24d38 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.724447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:18.735781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.736433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.737230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.737503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] PATH_INFO: `/v3/projects/abcc1554da1e4256814652000900678a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.738685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=abcc1554da1e4256814652000900678a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.740133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1cef5-a6a7-44f3-a1d9-d7007e0ba6e7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.742071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 91/181] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/projects/abcc1554da1e4256814652000900678a => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:18.747896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:18.890076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771fd42-5900-43cc-92e0-3341b19d7d06 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:18.921248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f7d5-685c-4dbf-907e-4d87e25febb0 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.921532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f7d5-685c-4dbf-907e-4d87e25febb0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.921739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886f7d5-685c-4dbf-907e-4d87e25febb0 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.923322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 92/182] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:18.931560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013808-e80f-490b-be80-764aa3797865 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.931836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013808-e80f-490b-be80-764aa3797865 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.932101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03013808-e80f-490b-be80-764aa3797865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.943397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:18.945524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:18.945997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:18.946679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:18.954258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=abcc1554da1e4256814652000900678a, user.id=6ef852dc81de44be839e711a9b299cf9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:18.955192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:18.963441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:18.967887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-03013808-e80f-490b-be80-764aa3797865 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:18.967887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-03013808-e80f-490b-be80-764aa3797865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:18.973513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 91/183] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:18 2022] GET /identity/v3/role_assignments?user.id=6ef852dc81de44be839e711a9b299cf9&scope.project.id=abcc1554da1e4256814652000900678a&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.046687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 93/184] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:19.099394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.184496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.226937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef0018-6e98-4c2a-b262-a0792c5cf271 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.227981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8919-ce9b-4833-9e20-1d6ed7237c76 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.228402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8919-ce9b-4833-9e20-1d6ed7237c76 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.228534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8919-ce9b-4833-9e20-1d6ed7237c76 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.230041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 94/185] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:19.236316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19597a-5922-427a-8811-0cf62462e74e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.236706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19597a-5922-427a-8811-0cf62462e74e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.237987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19597a-5922-427a-8811-0cf62462e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.263531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7f19597a-5922-427a-8811-0cf62462e74e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:19.263531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7f19597a-5922-427a-8811-0cf62462e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:19.276034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.276034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.276034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.276354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.295852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e5f5e083-ca60-456b-b9ce-e68b289ce83f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:19.302868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:19.303759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:19.304523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 92/186] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:19.305596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d42f-bc37-407f-b895-d2407d7ff833 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.305871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d42f-bc37-407f-b895-d2407d7ff833 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.306145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5d42f-bc37-407f-b895-d2407d7ff833 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.307540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 93/187] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:19.310301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d42f-bc37-407f-b895-d2407d7ff833 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.348263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 95/188] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:19.355531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.355938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.356217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.374339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:19.375641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:19.417906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5d42f-bc37-407f-b895-d2407d7ff833 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.426066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.441556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.450418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 96/189] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:19.453213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.453813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.454310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.454581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.455231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.456038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.457407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.459984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.471008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 94/190] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.474245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.597020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009e010-bbf5-437d-b21c-2c064dfe9db7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.597256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4cafb-d40b-402e-89e8-7a03ba40dc64 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.633622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.634289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.634576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.634852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.639497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.640269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.640684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.641091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.648812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.650287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.651733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:19.656534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 95/191] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.656534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:19.661825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:19.662894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:19.663864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:19.670623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 97/192] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:19.670623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.699610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.718482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.755816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b8b7-fca6-4d8a-9536-2fe261436804 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.773799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee37e6-1255-4635-bb0a-df94d6c67360 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.790078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.790730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.791005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.791291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.792365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.793784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.795516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 96/193] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.796105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.811192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.811791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.812064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.812327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.878560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.880020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.895064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670461df-3900-4d1c-81cc-194d8b848465 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:19.905448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.921402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:19.928860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:19.929448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:19.929721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:19.929988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:19.930686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:19.930981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:19.932335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:19.940862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 97/194] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:19.941655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:19.978558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 98/195] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:19.979299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.046573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022b6a-bee0-4c0c-b2b8-43cc9227fa3a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.076872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bd653-e60f-492a-843c-60da21a53d91 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.079284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.079905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.080181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.080489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.090702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:20.097142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:20.098149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 98/196] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:20.103687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.113210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.113823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.114100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.114407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.115051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.116487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.131283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.195871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7d54b-5c66-47f7-9aa0-d1239effb20e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.222169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.227259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 99/197] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:19 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:20.228053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.229447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.229910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.230195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.230476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.231761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.233251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.240286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 99/198] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.240286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.351273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c28c7-817f-4933-97a5-91420db38fdc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.355701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.359420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b67778-8741-4989-aaf0-609bd5c1eb95 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.398592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.398912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.399205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.399477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.399574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.399739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.399830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.400072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.400397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:20.400692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.401203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.402044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.402672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.404521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 100/199] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.405105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.411772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 100/200] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.412850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.488410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.536528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5686-e55d-42f5-a7b2-5fb72e503ebf None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.544142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2b90-b00a-4472-89e6-2fff12437d2b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.580536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.581265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.581516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.581640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.581856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.582119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.582427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.582699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.583419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=dc57011abd2247ac8416e052369120e4) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:20.583720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.585168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.592224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 101/201] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/role_assignments?user.id=dc57011abd2247ac8416e052369120e4&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.594031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.625330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.663657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.665721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.707316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2107c-ffe7-438b-be44-9fa3b541a339 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:20.754638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.764051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:20.764773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:20.765055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:20.765330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] PATH_INFO: `/v3/users/f07825b7f93d4149a12a15071e2609e3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:20.767293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] RBAC: Authorizing `identity:get_user(user_id=f07825b7f93d4149a12a15071e2609e3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:20.768894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:20.774969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 102/202] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/users/f07825b7f93d4149a12a15071e2609e3 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:20.777213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.844935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 101/203] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:20.855198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:20.933820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:20.944909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe601d6-68c9-4359-a623-b1d1f28584fe None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.012490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.015190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.015673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.016139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.069109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12f67-2d0f-46b0-86b3-c5f219c13ccc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.117390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.118394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.118868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.119350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.120657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.122379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.124578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 102/204] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.130992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.166519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.211512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.212989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.287204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c512d19-b5a9-41de-80ef-76708a4f1930 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.322749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.323365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.323778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.324119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.324978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=dc57011abd2247ac8416e052369120e4) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:21.325355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.326899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.332822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 103/205] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/role_assignments?user.id=dc57011abd2247ac8416e052369120e4&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:21.360249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.369635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 103/206] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:21.375541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.513128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:21.517548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49d957-a414-4908-be0e-598e0d7a2c88 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.556823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.557397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.558109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.558413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.559754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.561614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a05eb-6798-4108-a178-fa2914621b91 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.566561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 104/207] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:21.572609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:21.707994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba028e5c-9c88-4c65-b53a-9d565c566a96 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:21.754858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:21.755849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:21.756320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:21.756784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:21.757703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1, user.id=f07825b7f93d4149a12a15071e2609e3) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:21.758242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:21.759878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfba197-ea69-41cd-a8d8-5d0ce1f8d433 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:21.766468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 104/208] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:21 2022] GET /identity/v3/role_assignments?user.id=f07825b7f93d4149a12a15071e2609e3&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:22.484043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05951-f4a7-4a90-89f0-1785ed0b4751 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.484544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05951-f4a7-4a90-89f0-1785ed0b4751 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.484663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05951-f4a7-4a90-89f0-1785ed0b4751 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.486065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 105/209] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:22.492103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3808-a9c2-49b8-b02b-19c4b9f88e85 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.492920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3808-a9c2-49b8-b02b-19c4b9f88e85 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.493462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3808-a9c2-49b8-b02b-19c4b9f88e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.516596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-31ee3808-a9c2-49b8-b02b-19c4b9f88e85 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:22.518640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-31ee3808-a9c2-49b8-b02b-19c4b9f88e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:22.579206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:22.593715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 105/210] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:22.742763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff3fc-d0d9-492f-af25-db97ef1b97fc None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.743088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff3fc-d0d9-492f-af25-db97ef1b97fc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.743316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff3fc-d0d9-492f-af25-db97ef1b97fc None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.744855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 106/211] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:22.750699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902ab7-b19e-4e4c-b4e7-b9aca664d001 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.750987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902ab7-b19e-4e4c-b4e7-b9aca664d001 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.751267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c902ab7-b19e-4e4c-b4e7-b9aca664d001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.770563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5c902ab7-b19e-4e4c-b4e7-b9aca664d001 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:22.771736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5c902ab7-b19e-4e4c-b4e7-b9aca664d001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:22.840829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:22.868937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ff3fc-d0d9-492f-af25-db97ef1b97fc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:22.875354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847200-3e4e-4cfb-8161-e027f8530251 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.875648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847200-3e4e-4cfb-8161-e027f8530251 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.875927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80847200-3e4e-4cfb-8161-e027f8530251 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.878042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 107/213] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:22.882864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:22.883185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:22.883537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:22.903745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:22.904940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:22.982427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ff3fc-d0d9-492f-af25-db97ef1b97fc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:22.982618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 108/214] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:23.024489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.025126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.025406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.025681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.037334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:23.042542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:23.043384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:23.044169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 107/215] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:23.050846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.103872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.132496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.162423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.232898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4619f-afee-4f27-aa39-81fa51862104 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.270744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbb168-46fc-475f-81a0-8673d9dd6535 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.277474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.278526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.278811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.279081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.279740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:23.280392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.282071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.291393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 109/216] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:23.291393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.309682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.310445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.310795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.311137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.312319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.313760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.315404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 108/217] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:23.315404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.401648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a84c6d-27d3-4ad7-bf31-e569935a13c1 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.411898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.420334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.427722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b13fd6-c81d-4016-a667-77eaabb86618 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.434774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.435528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.435807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.436076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.446801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:23.451953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:23.453277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:23.454051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 110/218] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:23.454762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.462545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.463180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.463452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.463735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] PATH_INFO: `/v3/users/61d0e447d83a43a39b60fca1bd69ff4f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.477961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] RBAC: Authorizing `identity:get_user(user_id=61d0e447d83a43a39b60fca1bd69ff4f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.479446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6351e-cc40-43e3-8911-af10aea68e6f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.481057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 109/219] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/users/61d0e447d83a43a39b60fca1bd69ff4f => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:23.482204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0956f-2e9b-4e03-972f-cefda93fc6ec None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.482486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0956f-2e9b-4e03-972f-cefda93fc6ec None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.482757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0956f-2e9b-4e03-972f-cefda93fc6ec None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.483947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 110/220] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:23.484642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0956f-2e9b-4e03-972f-cefda93fc6ec None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.558576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8189e-414d-44a4-9e51-d2764fd515e2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.591547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0956f-2e9b-4e03-972f-cefda93fc6ec None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.592365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.592967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.593241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.593509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.594136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.595606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d0ce5-a2dc-40d2-9672-6b916a2e9a72 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.627930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.628529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.628805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.629073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.629751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:23.630050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.631491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.639467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 111/221] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:23.640322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.656028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.700979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 111/222] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:23 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:23.702219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.702507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.703032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.730510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:23.731889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:23.745684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0e567-71ff-418d-9f58-ef09dbebf24b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.756796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.786764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.787384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.787652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.787921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.816510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 112/223] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:23.817527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:23.882261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.882449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.897845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:23.942554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977896d4-5c12-4771-b14e-320d31ee0ee5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:23.988224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:23.989132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:23.989401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:23.989663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:23.990807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:23.992846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:23.994016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 113/224] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:23.999341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.012094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 112/225] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:24.018493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.032966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.137769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590549be-570a-4fc9-8511-fc2aa2141b11 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.163590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272329e-151c-4d89-90b7-ac7cb5082a60 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.178732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.179714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.180196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.180693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.182043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.182596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.183999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.186171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:23 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:24.187232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.209542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.210114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.210574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.210851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.212019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.214024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.216282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:24.218290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.312263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.322784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18eb82-783f-4130-a541-1751260ed02f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.356200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2afdf-ff7f-4524-9a6f-bfe6219601be None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.368461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.369189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.369539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.369884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.385936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:24.391853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:24.392784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:24.398623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.400595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.401506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.401981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.402479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/users/dc57011abd2247ac8416e052369120e4/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.404798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, user_id=dc57011abd2247ac8416e052369120e4, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.406518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.494706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 114/229] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:24 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/users/dc57011abd2247ac8416e052369120e4/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:24.496645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.505454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb75e-cfcd-4108-8591-2f507fe2da8a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.546408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.547037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.547316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.547643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.548470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=61d0e447d83a43a39b60fca1bd69ff4f) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:24.548781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.550411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.556700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.557612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/role_assignments?user.id=61d0e447d83a43a39b60fca1bd69ff4f&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.638328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a2237-64e1-4650-8ce1-b2807e11f73c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.685941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.686968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.687452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.687929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.688843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:24.689373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.691101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.701180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 115/231] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.709741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:24.742420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:24.839434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46e36-bec7-406b-b93f-e67a3b730e46 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:24.882245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:24.882893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:24.883172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:24.883448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:24.886919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:24.888391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:24.889993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 117/232] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:24.896788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:25.027450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95247961-6ccf-4cc2-98d3-5bae03203fd1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:25.031087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:25.076287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:25.077294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.078054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.078545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.079925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:25.081740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc25f-b064-4f60-9282-015cb313636c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:25.083669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 116/233] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:24 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:25.089982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:25.218622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:25.239775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39422f8-d491-496c-ae99-3735ac2c9268 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:25.282646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:25.283325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.284148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.284420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/users/dc57011abd2247ac8416e052369120e4/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.286623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, user_id=dc57011abd2247ac8416e052369120e4, role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:25.291424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec547f-7116-4712-8a74-7a98918d41cf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:25.368072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 118/234] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:25 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/users/dc57011abd2247ac8416e052369120e4/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:25.990330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73c80-fbde-4846-9320-30dfec6c5587 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.991366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73c80-fbde-4846-9320-30dfec6c5587 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:25.991870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf73c80-fbde-4846-9320-30dfec6c5587 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:25.993674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 117/235] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:25.999149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496bcfd-76f5-4a6c-ad7e-f3e8fc5af420 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:25.999965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496bcfd-76f5-4a6c-ad7e-f3e8fc5af420 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.000456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496bcfd-76f5-4a6c-ad7e-f3e8fc5af420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.019545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f496bcfd-76f5-4a6c-ad7e-f3e8fc5af420 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:26.021060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f496bcfd-76f5-4a6c-ad7e-f3e8fc5af420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:26.091837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 119/236] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:26.372666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338c01-26ab-436b-8adf-43809fc98e7d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.373321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338c01-26ab-436b-8adf-43809fc98e7d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.373819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338c01-26ab-436b-8adf-43809fc98e7d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.375670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 118/237] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:26.380529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.381032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.381526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.410798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:26.412328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:26.420741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338c01-26ab-436b-8adf-43809fc98e7d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.526932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:26.586652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338c01-26ab-436b-8adf-43809fc98e7d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.621668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.622321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.622597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.622868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.633901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:26.639026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:26.639878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:26.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 119/239] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:26.646223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.649824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.757002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275408ff-9bf3-467a-ae03-e5b377fed66b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.792838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d88977-31c7-4255-829e-c88740108407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.793446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88977-31c7-4255-829e-c88740108407 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.793721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88977-31c7-4255-829e-c88740108407 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.793984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88977-31c7-4255-829e-c88740108407 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.794681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88977-31c7-4255-829e-c88740108407 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:26.794983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88977-31c7-4255-829e-c88740108407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:26.796358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88977-31c7-4255-829e-c88740108407 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:26.805755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 121/240] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:26.811251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.844272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.847583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d88977-31c7-4255-829e-c88740108407 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:26.919430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:26.959291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d88977-31c7-4255-829e-c88740108407 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:26.997667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:26.998330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:26.998606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:26.998876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:26.999969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.001475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.003243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 122/241] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:27.008763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.016369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5952-279b-40d7-a0db-5f6eb1086aeb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.089880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.091236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.091977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.092647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] PATH_INFO: `/v3/users/2ba62247968a47fd94733ec3266c7a0b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.117810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba62247968a47fd94733ec3266c7a0b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.117810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f233e5-5ec5-4d84-bed2-960b04c81ed5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.121750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 120/242] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:26 2022] GET /identity/v3/users/2ba62247968a47fd94733ec3266c7a0b => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.123917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267385e-62fe-4834-8eed-9205506b2744 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.124377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267385e-62fe-4834-8eed-9205506b2744 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.124885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267385e-62fe-4834-8eed-9205506b2744 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.126487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 121/243] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:27.128666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9ae1-162a-4514-ae0f-5b2028139af5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.129098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9ae1-162a-4514-ae0f-5b2028139af5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.129557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa9ae1-162a-4514-ae0f-5b2028139af5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.131337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 122/244] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:27.131572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4c933-d8da-4fc5-9fee-d2b2fa9f962f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.133630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.134429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.135212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.153912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:27.155131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:27.172141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.172750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.173021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.173287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.173925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.175914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3887068-b33c-4558-a37d-07df9becce0b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.183724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.224573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 123/245] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:27.225475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.247303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.292055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 123/246] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:27 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:26:27.293954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.294363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.294762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.340371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:27.341967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:27.399394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150f27e-b1d9-4aaf-9f6a-d62875aac7f6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.462587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.463212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.463488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.463753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.484617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 124/247] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:27.501923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.538607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.540071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.570929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.626594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb1f91-940c-4f47-8c4a-552d25ef05ab None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.648645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.663480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 124/248] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:27.667688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.671934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.672644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.672924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.673198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.686151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:27.691931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:27.692815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:27.694020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 125/249] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:27.701534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.803781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f0b8-eae5-4503-9708-23ff33648b43 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.832707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.840637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97267c2-0edf-407b-91a7-0846e6087bc8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:27.855191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.855407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.855670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.856606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.857096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.859528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.861392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 125/250] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:27.863791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.891368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:27.892340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:27.892451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:27.892631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:27.893336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:27.893632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:27.895100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:27.904870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 126/251] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:27.905707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:27.964470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:27.984830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a8cb8-060a-4f06-b001-4f48a13a4122 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.021977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.023512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.024024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.024499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.028922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244263-c821-492e-802d-f61ee0a2e937 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.036856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-48d25485-0b11-4a46-98ea-c2bea8b54b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:28.042577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:28.043485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:28.044265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:28.046566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:28.047953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2368-de19-4ed9-b45e-a436225c1c0e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.048439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2368-de19-4ed9-b45e-a436225c1c0e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.048961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2368-de19-4ed9-b45e-a436225c1c0e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.050777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 127/253] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:28.056136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb2368-de19-4ed9-b45e-a436225c1c0e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.066604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.067144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.067419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.067769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.068499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=2ba62247968a47fd94733ec3266c7a0b) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:28.068805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.070538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.076341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 127/254] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:27 2022] GET /identity/v3/role_assignments?user.id=2ba62247968a47fd94733ec3266c7a0b&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.077303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.122520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.185335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb2368-de19-4ed9-b45e-a436225c1c0e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.249930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.250514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.250788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.251058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.253428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.254906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355529ea-8866-4614-b640-a916b4fa708f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.256651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.257614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.257951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.258297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.291579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:28.293072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:28.324311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9947c8-9f3c-4b67-92b5-d7919baa484b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.339257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.369775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 129/256] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:28.371143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.410892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.411512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.411791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.412060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.412724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:28.413023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.414438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.426764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.433370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 128/257] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.438850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.530069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e5cd-edbc-4155-b4ae-79a5deb54ba1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.575643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.576633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.577105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.577566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.649127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.650943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.675014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f9c03-db3d-4a80-ba66-3bbea74de5c4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.698083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.715591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.716227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.716575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.716782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] PATH_INFO: `/v3/users/61d0e447d83a43a39b60fca1bd69ff4f` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.717963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] RBAC: Authorizing `identity:get_user(user_id=61d0e447d83a43a39b60fca1bd69ff4f)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.719458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.721358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 129/258] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/users/61d0e447d83a43a39b60fca1bd69ff4f => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:28.726579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.757548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 130/259] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:28.762824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.774556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:28.836915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44e494-96b2-4f75-ae19-4a916feaa4b2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.873401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.874035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.874359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.874677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.876996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82709-eb9f-4042-89e7-68c45cfb3bc5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:28.885660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:28.890740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:28.891600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:28.892506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 130/260] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:28.893185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.931753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:28.932772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:28.933243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:28.933705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:28.939167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:28.940754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:28.942737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:28.943503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:28.973109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.003232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.009187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36638a-8085-4a6d-9a16-5d72b07ed139 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.045885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.047692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.047974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.048250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.051507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.055635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.058898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:29.059701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.187149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf7b0-ca2f-4022-8921-0f0f27fc5388 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.220096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fe9c7-a54a-4f0d-a66a-4231766a1a59 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.225094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.225818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.226111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.226439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/users/61d0e447d83a43a39b60fca1bd69ff4f/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.228462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, user_id=61d0e447d83a43a39b60fca1bd69ff4f, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.230553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.267519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.268151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.268482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.268760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.270752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:29.270752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.271197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.280043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:29.280767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.328249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:29 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/users/61d0e447d83a43a39b60fca1bd69ff4f/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:29.328953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.393390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.436949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.471765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d1034-6acc-4bc3-855b-ebcaf249e370 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.510361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.511240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.511708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.512126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.513056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=dc57011abd2247ac8416e052369120e4) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:29.513519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.515160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.522110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/role_assignments?user.id=dc57011abd2247ac8416e052369120e4&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:29.543378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ac4f-fb7e-4a30-b204-73cdf7e9b0d6 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.592402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.593057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.593335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.593613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] PATH_INFO: `/v3/users/dc57011abd2247ac8416e052369120e4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.594836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc57011abd2247ac8416e052369120e4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.596932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.598602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 133/266] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/users/dc57011abd2247ac8416e052369120e4 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:29.604782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:29.745952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913af0-bd6c-4c28-9565-5f0ed841b2e9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:29.785242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:29.786241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:29.786779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:29.787254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:29.799094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:29.860448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:29.862064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea65d5-e4a5-4534-99bc-0ab90f63582e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:29.966153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 134/267] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:29.974854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.100446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c898-e7d2-4aa4-9f70-5f4a3a9b73fb None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.100800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c898-e7d2-4aa4-9f70-5f4a3a9b73fb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.101067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139c898-e7d2-4aa4-9f70-5f4a3a9b73fb None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.102715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 135/268] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.108968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44374-0804-4c23-a0fe-e2e1224ab290 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.110336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44374-0804-4c23-a0fe-e2e1224ab290 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.110927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44374-0804-4c23-a0fe-e2e1224ab290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.123438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.138624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32bd2-9118-4351-8ddb-e1c162c038e4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.139078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-60b44374-0804-4c23-a0fe-e2e1224ab290 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.140489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-60b44374-0804-4c23-a0fe-e2e1224ab290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.186538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.207984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.208654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.208931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.209207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.212069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.213513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.215361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 134/269] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:29 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:30.221765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.268689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 136/270] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:30.270351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d128ad-bb30-48cc-a219-31ff837be547 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.270642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d128ad-bb30-48cc-a219-31ff837be547 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.270920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d128ad-bb30-48cc-a219-31ff837be547 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.272496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 137/271] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.277547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.277830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.278102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.327281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:30.328742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:30.366433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da5b3-c64f-4dab-865d-c40906e9eaec None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.430091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.430962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.431384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.431824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=dc57011abd2247ac8416e052369120e4) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:30.433252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.435010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.446368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 135/272] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/role_assignments?user.id=dc57011abd2247ac8416e052369120e4&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:30.450355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:30.570164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.604154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.688902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ab16-4e71-4915-af02-199e675401a9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.723646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.724277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.724555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.724830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.725996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.727491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.729055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 136/274] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:30.734759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.792736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:30.863841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.867165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cfb18-32ba-45cc-bfbf-f02b0f608013 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.911123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.911347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:30.911431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.911431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.911562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.912155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:30.913606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26396193-37e1-4f45-92fa-0960f80afab4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:30.925287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b1748-f82b-45d0-b9af-0b0a0788dd89 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:30.961237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:30.961237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.961493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.961642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.972436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-8a80a7c1-8bf0-49a2-a769-9c9b91cfb247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:30.977623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:30.978559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:30.979405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 137/275] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:30.983496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae1c-74aa-4e83-b7e4-266a7f177ffe None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:30.983779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae1c-74aa-4e83-b7e4-266a7f177ffe None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:30.984053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbae1c-74aa-4e83-b7e4-266a7f177ffe None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:30.985329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 138/276] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:30.986027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbae1c-74aa-4e83-b7e4-266a7f177ffe None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.021403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 139/277] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:30 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:31.022683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.022974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.023250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.048846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:31.051286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:31.129876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbae1c-74aa-4e83-b7e4-266a7f177ffe None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.144936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:31.178332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.179275 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.179767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.180246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.181095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.181597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.183002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.191563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 139/279] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.197096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.299499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.316698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f43600-2905-4195-bf9e-74eaf05d0e28 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.354809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.355447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.355720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.355989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] PATH_INFO: `/v3/users/e0fc9a15cc8a4b989b364a329ae3101c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.371127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fc9a15cc8a4b989b364a329ae3101c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.372586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.374263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 141/280] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/users/e0fc9a15cc8a4b989b364a329ae3101c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.380835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.397644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.436446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.504022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc257-c221-4f82-8ae9-0f1c204fe94e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.554655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.555189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.555465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.555739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.556460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, user.id=e0fc9a15cc8a4b989b364a329ae3101c, scope.system=all) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.556760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.558362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.563630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 140/281] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/role_assignments?user.id=e0fc9a15cc8a4b989b364a329ae3101c&scope.system=all&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.566680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab803e3-ba11-4a92-a19b-32b577b9a649 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.617942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.618604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.618883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.619149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.636292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:31.641506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:31.642417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:31.643751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 142/282] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:31.650790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.771684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.796518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c003f3-aaa2-48aa-a552-5fa23e02fffd None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.833338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:31.834334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.834817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.835297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.836171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:31.836684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:31.838309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9d79b-e8af-4b4e-9ba4-fdf2bd447d4e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:31.848072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 141/283] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:31.859272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:31.863366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:31.985795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc426e0-9b4a-48b6-9b6f-3eae6f7d5c2d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:31.990160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728e59-9594-4e71-b3f7-9e043bc2d5d7 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.990481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728e59-9594-4e71-b3f7-9e043bc2d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.990763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4728e59-9594-4e71-b3f7-9e043bc2d5d7 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:31.993462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 142/284] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:31.997682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:31.997961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:31.998248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.022333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.022969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.023242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.023509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] PATH_INFO: `/v3/users/2ba62247968a47fd94733ec3266c7a0b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.024635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba62247968a47fd94733ec3266c7a0b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.026073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.028121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 143/285] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:31 2022] GET /identity/v3/users/2ba62247968a47fd94733ec3266c7a0b => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:32.034713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.035912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:32.037076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:32.140719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.168945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:32.209587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74fec2-f77d-492a-a09f-eda12a1980c6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.243531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.244159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.244433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.244704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.245808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.247278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.249088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:32.254939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.326870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.358438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabe083-9c6e-4d5a-b80e-0602df3e0a10 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.393436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.394073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.394377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.394656 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/users/2ba62247968a47fd94733ec3266c7a0b/roles/fdcd71013b374d5bbfc7e20344176cf1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.396548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, user_id=2ba62247968a47fd94733ec3266c7a0b, role_id=fdcd71013b374d5bbfc7e20344176cf1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.397973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.476262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 144/288] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:26:32 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/users/2ba62247968a47fd94733ec3266c7a0b/roles/fdcd71013b374d5bbfc7e20344176cf1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:26:32.547480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.681329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594286d0-e886-43eb-bc8d-60cc169e6885 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.729368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.730437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.730968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.731444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.745730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.751209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:32.756899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:32.757766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:32.758598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:32.760896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 145/289] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:32.766929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:32.902699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304de8-1acc-42ce-a7cc-1a56920fe085 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:32.932759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:32.944015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:32.944635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:32.944917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:32.945199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:32.953904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:32.953904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:32.953904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:32.961186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 145/290] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:32.962589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:33.212697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb66b2-4a52-46ce-9622-2ec9b316f1c2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:33.270326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:33.270984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.271264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.271543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] PATH_INFO: `/v3/users/61d0e447d83a43a39b60fca1bd69ff4f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.278887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] RBAC: Authorizing `identity:get_user(user_id=61d0e447d83a43a39b60fca1bd69ff4f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:33.280374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52c113-996d-4322-af72-e1f941ed1e10 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:33.282332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 146/291] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:32 2022] GET /identity/v3/users/61d0e447d83a43a39b60fca1bd69ff4f => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:33.293937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:33.431143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4362-2822-499e-ae03-fd0df01a3847 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:33.474018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:33.474607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.474887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.475167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.555206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:33.565263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:33.566767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:33.569874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb188-2821-4b4b-be68-c514f35cf259 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.570343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb188-2821-4b4b-be68-c514f35cf259 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.570441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb188-2821-4b4b-be68-c514f35cf259 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.571781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 147/292] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:33.576867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cd91-0d91-4a1e-9266-77555819b09b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.577154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cd91-0d91-4a1e-9266-77555819b09b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.577434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cd91-0d91-4a1e-9266-77555819b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.619179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-84e1cd91-0d91-4a1e-9266-77555819b09b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.620687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84e1cd91-0d91-4a1e-9266-77555819b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:33.700724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 146/293] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:33.707292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:33.728730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:33.741250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 148/294] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:33.805711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a897d-2c7a-476a-af8d-3111ab3e50e8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.806358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a897d-2c7a-476a-af8d-3111ab3e50e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.806828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a897d-2c7a-476a-af8d-3111ab3e50e8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.808617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 149/295] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:33.813927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de8af-ff82-40f2-8c09-4a247fc533a9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.814517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de8af-ff82-40f2-8c09-4a247fc533a9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.815054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de8af-ff82-40f2-8c09-4a247fc533a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.842071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:33.845773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f23de8af-ff82-40f2-8c09-4a247fc533a9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.847332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f23de8af-ff82-40f2-8c09-4a247fc533a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:33.851135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31900ed5-f437-46e2-a944-2f990ddeca8d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:33.896458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:33.897805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.898341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.899152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.900742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:33.903112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00aca2-0ece-46b9-8417-b72961838607 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:33.905973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 147/296] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:33 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:33.907635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708857-ba79-4bf0-ae97-3ecafc25fbf7 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.908096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708857-ba79-4bf0-ae97-3ecafc25fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.908609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708857-ba79-4bf0-ae97-3ecafc25fbf7 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.911156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 148/297] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:33.912133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708857-ba79-4bf0-ae97-3ecafc25fbf7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:33.929305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 150/298] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:33.931048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:33.931539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:33.932040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:33.956711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:33.959057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:34.095567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708857-ba79-4bf0-ae97-3ecafc25fbf7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.106293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 151/299] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:34.107221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.138150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.139590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.140070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.140819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.141735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=61d0e447d83a43a39b60fca1bd69ff4f) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:34.142270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.143944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.151316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 149/300] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:33 2022] GET /identity/v3/role_assignments?user.id=61d0e447d83a43a39b60fca1bd69ff4f&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.232505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.242957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.293425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.314449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbcdcf-e675-49ba-bba3-dc282b84f9f1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.367724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.368681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.369129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.369569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.381662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:34.386881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:34.387742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:34.388525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:34.392000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 152/301] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:34.400524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.407445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95763f-1f0b-458c-8fc2-50f798ee373b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.458102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.459084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.459505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.459917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.477578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:34.482885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:34.483781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 150/302] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:34.484957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.547713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c622b-5876-47c0-b97a-da71961aee5f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.571153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.591164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.592932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.593603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.593886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.594152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.595333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:34.595639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.597537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.606192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 153/303] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:34.607092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.612632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62d76-d8df-4993-a929-e840eb78e7e8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.649825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.650759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.651039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.651613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.652848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.654311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.655875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 151/304] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.656636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.719048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6bd2-bb3e-4601-888b-b0a89f6fdb73 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.754633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.755243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.755524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.755799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.756451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:34.756753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.758241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.759040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739adf0-2238-4df2-8b38-2aa86b3f9e80 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.768128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 154/305] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.768839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.804719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.806642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.806642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.806905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] PATH_INFO: `/v3/users/fa055a600b694b6f9805edbab3c8be6e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.816150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.822448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] RBAC: Authorizing `identity:get_user(user_id=fa055a600b694b6f9805edbab3c8be6e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.830809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.830809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 152/306] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/users/fa055a600b694b6f9805edbab3c8be6e => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.830809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.846940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:34.876063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98b50a-d030-4343-a978-afe5e281080d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.914781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.915320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.915595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.915864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] PATH_INFO: `/v3/groups` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.916475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.917912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2b92e-9288-4e5c-a9b5-02bd9328dd19 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.935695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60172be5-ef9f-4ddb-9a26-4f0328f0fb13 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:34.968008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:34.968634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.968904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.969174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] PATH_INFO: `/v3/users/e0fc9a15cc8a4b989b364a329ae3101c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.970309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fc9a15cc8a4b989b364a329ae3101c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:34.972261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:34.973829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 153/307] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/users/e0fc9a15cc8a4b989b364a329ae3101c => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:34.974610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:34.989675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 155/308] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Aug 22 12:26:34 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:34.989675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac93e5-f9c7-4e0b-8a3d-97671babb36c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:34.989675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac93e5-f9c7-4e0b-8a3d-97671babb36c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:34.989675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac93e5-f9c7-4e0b-8a3d-97671babb36c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:34.990288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 156/309] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:34.991007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac93e5-f9c7-4e0b-8a3d-97671babb36c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.078700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.104115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b46a3-08c9-445e-a95d-b0db3cbd0d24 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.120381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac93e5-f9c7-4e0b-8a3d-97671babb36c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.122159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.148281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.148899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.151593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.151593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.151593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, user.id=fa055a600b694b6f9805edbab3c8be6e, scope.system=all) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:35.151593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.152054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51a1d6-ebc8-4c1e-bf66-7c7417151f0b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.157180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 154/310] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:34 2022] GET /identity/v3/role_assignments?user.id=fa055a600b694b6f9805edbab3c8be6e&scope.system=all&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:35.162462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.163062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.163496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.167185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.167789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.168181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.168491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] PATH_INFO: `/v3/system/users/e0fc9a15cc8a4b989b364a329ae3101c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.169931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e0fc9a15cc8a4b989b364a329ae3101c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.171449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.183973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:35.185707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:35.268372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 157/311] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Aug 22 12:26:34 2022] PUT /identity/v3/system/users/e0fc9a15cc8a4b989b364a329ae3101c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:35.270307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 155/312] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:35.541676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.643750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb9c61-e9c2-4c18-969c-38ff3de9c9fb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.682213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.682213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.682213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.682557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.693799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:35.699026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:35.699907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:35.700702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 158/313] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:35.708115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.785611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.810241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d30de-e65d-4b57-99fd-eb449fe97710 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:35.846936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:35.847608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:35.847893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:35.848168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:35.848830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:35.849130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:35.850517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:35.859084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 156/314] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:35.867224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:35.896111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:35.972333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7635b-a28e-4771-a59b-9d08d932c92f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.006815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.007552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.007830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.008102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] PATH_INFO: `/v3/users/2ba62247968a47fd94733ec3266c7a0b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.009230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba62247968a47fd94733ec3266c7a0b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.010711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.012294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 159/315] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:35 2022] GET /identity/v3/users/2ba62247968a47fd94733ec3266c7a0b => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:36.018655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:36.125046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dda4f1-8f64-4f53-924f-6f725ea34d6e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.161888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.162534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.162815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.163089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.165736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:36.233882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.235384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.347001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 157/316] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:36.352393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:36.455219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:36.462605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5c52-ec89-47b6-9415-dda3b682c570 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.496445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.497356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.497811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.498281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.499573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.501343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fafb6-97be-457e-a549-7815fb2af003 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.504140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 160/317] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:36 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:36.510143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:36.544786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:36.613376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0c91b-a103-4cb5-86d9-52f5a298abb5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:36.649513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:36.650122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:36.650711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:36.650984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:36.651706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, scope.project.id=35831b1e745d4a7090713d727e93e21d, user.id=2ba62247968a47fd94733ec3266c7a0b) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:36.652009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:36.653434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05680b58-69e9-4565-b173-59a81010ce86 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:36.660149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 158/318] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:26:36 2022] GET /identity/v3/role_assignments?user.id=2ba62247968a47fd94733ec3266c7a0b&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.012331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7335ea-b6c4-4e07-9af9-1677868ec72b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.012838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7335ea-b6c4-4e07-9af9-1677868ec72b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.012913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7335ea-b6c4-4e07-9af9-1677868ec72b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.014367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 161/319] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:37.019491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73a90e-3395-40f6-9859-9a1373df2a31 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.019868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73a90e-3395-40f6-9859-9a1373df2a31 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.020027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73a90e-3395-40f6-9859-9a1373df2a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.038482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9c73a90e-3395-40f6-9859-9a1373df2a31 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:37.039649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9c73a90e-3395-40f6-9859-9a1373df2a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:37.108550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 159/320] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:37.205853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa05d-4064-460d-9834-729f7d0b182c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.206164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa05d-4064-460d-9834-729f7d0b182c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.206426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa05d-4064-460d-9834-729f7d0b182c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.207898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 162/321] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:37.211635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe419-96bb-4a04-9b1e-84e716a401cf None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.211916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe419-96bb-4a04-9b1e-84e716a401cf None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.212184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe419-96bb-4a04-9b1e-84e716a401cf None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.212426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.212707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.212979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.213771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 160/322] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:37.218457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.218739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.219009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.233107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:37.234609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:37.237586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:37.238757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:37.264208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.313632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 163/323] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:37.314166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 161/324] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:37.387864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.479486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.488795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880d626-c87e-4082-8e1d-4664cd18d4e3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.522658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.523223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.523500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.523771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.524865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.526371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.528086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 164/325] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.533574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.579015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.632647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ccb54-26e8-4966-bc5a-026f8d993b6d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.664856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.665451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.665724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.665998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] PATH_INFO: `/v3/groups` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.666642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.668053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.676215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132f88a-2eb6-40dd-9ed4-fe92a7af70fe None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.709859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.710518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.710796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.711068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.721409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:37.726125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:37.728625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 165/326] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:37.729395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.749301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.763500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 162/327] 10.222.0.15 () {60 vars in 1134 bytes} [Mon Aug 22 12:26:37 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:37.764316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.787324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:37.840400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f1626-6416-44d8-9f79-e9cf6fef06a2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.881476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610f158-0821-4b7b-8d3c-5bf44c318cf0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:37.884508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.885156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.885431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.885699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.897513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:37.902384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:37.903261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:37.904059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 166/328] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:37.909926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:37.926910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:37.928555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:37.928555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:37.928555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:37.928866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:37.929160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:37.931058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:37.940388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 163/329] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:37.946081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:38.004593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:38.031868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed60b9-8b61-4f75-aa34-d3668cf87a31 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.049276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:38.076701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.077314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.077591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.077865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.078866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:38.079165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.079390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87f6a9-2fe1-4f11-9b26-4f29d9947cd2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.081118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.091742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 167/330] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:38.097512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:38.137333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.138297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.138728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.138998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] PATH_INFO: `/v3/users/fa055a600b694b6f9805edbab3c8be6e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.140148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] RBAC: Authorizing `identity:get_user(user_id=fa055a600b694b6f9805edbab3c8be6e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.141624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.144997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 164/331] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:37 2022] GET /identity/v3/users/fa055a600b694b6f9805edbab3c8be6e => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:38.148933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:38.244696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6ae3-4406-427e-a3f5-5251ead87540 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.275675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d8290-3526-4986-80ac-95ca901a1ebd None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.289737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.290708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.291188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.291767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] PATH_INFO: `/v3/users/e0fc9a15cc8a4b989b364a329ae3101c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.293111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0fc9a15cc8a4b989b364a329ae3101c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.294800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.296964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 168/332] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:38 2022] GET /identity/v3/users/e0fc9a15cc8a4b989b364a329ae3101c => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:38.304969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:38.326329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.327420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.327955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.328686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] PATH_INFO: `/v3/system/users/fa055a600b694b6f9805edbab3c8be6e/roles/fdcd71013b374d5bbfc7e20344176cf1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.330958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa055a600b694b6f9805edbab3c8be6e, role_id=fdcd71013b374d5bbfc7e20344176cf1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.332609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8483e-c3bf-475f-95cc-7c6f656c5f5b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.334517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:38.393343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 165/333] 10.222.0.15 () {58 vars in 1334 bytes} [Mon Aug 22 12:26:38 2022] PUT /identity/v3/system/users/fa055a600b694b6f9805edbab3c8be6e/roles/fdcd71013b374d5bbfc7e20344176cf1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:26:38.443139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bcf7c-d900-46cb-ad77-b41f159bbed4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:38.484696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:38.485716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:38.486220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:38.486760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:38.487704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] RBAC: Adding query filter params (role.id=2816f759300c43c69378fdf8eaca6e20, user.id=e0fc9a15cc8a4b989b364a329ae3101c, scope.system=all) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:38.488217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:38.489913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f3c6c-708a-4d84-86d7-5fb96c7e7777 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:38.504521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 169/334] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:38 2022] GET /identity/v3/role_assignments?user.id=e0fc9a15cc8a4b989b364a329ae3101c&scope.system=all&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:39.919541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9377-29d0-4499-8b5b-136557cbb9ad None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:39.920046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9377-29d0-4499-8b5b-136557cbb9ad None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:39.920147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9377-29d0-4499-8b5b-136557cbb9ad None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:39.921641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 166/335] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:39.927554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d302-490b-4c37-831d-56e546d8a5d5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:39.927944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d302-490b-4c37-831d-56e546d8a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:39.928123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282d302-490b-4c37-831d-56e546d8a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:39.946295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e282d302-490b-4c37-831d-56e546d8a5d5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:39.947468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e282d302-490b-4c37-831d-56e546d8a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:40.025159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:40.035398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 170/336] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:40.331375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071779-1ab4-4b3c-999e-d4c5214d16c4 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.331707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071779-1ab4-4b3c-999e-d4c5214d16c4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.331912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44071779-1ab4-4b3c-999e-d4c5214d16c4 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.333477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 167/337] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:40.352061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.352346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.352617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.374805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:40.375981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:40.447060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 171/338] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:40.509239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44071779-1ab4-4b3c-999e-d4c5214d16c4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.524801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:40.619892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44071779-1ab4-4b3c-999e-d4c5214d16c4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:40.659122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:40.659754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.660028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.660295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.673356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-000bdb86-c1d9-46ef-b90c-9366b25f1554 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:40.678770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:40.679646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:40.680434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 168/339] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:40.685661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.799570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc7c1b-7629-4137-bbf1-7da7de67952e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:40.811763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e925a-e139-45a3-858f-2213cd36e2ba None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.812058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e925a-e139-45a3-858f-2213cd36e2ba None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.812293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e925a-e139-45a3-858f-2213cd36e2ba None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.813768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 169/340] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:40.819663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.819948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.820225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.839941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:40.852872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:40.853503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:40.853775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:40.854046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:40.854815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:40.855119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:40.855406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:40.862601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:40.862722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:40.871519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 172/341] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:40.876879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:40.960290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 170/342] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:41.038213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d458e88-d1ea-421e-b7d5-eb8a2d2f79d3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.072671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.073273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.073545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.073810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.080951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.085325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.233948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.250561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.253496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbdd23-8900-492f-b492-7b9131d423f7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.310738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76affcf0-6288-447e-a09c-52fb87d9d355 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.362748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.363398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.363687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.363938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.387473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-5c372f67-f696-4bed-967b-c07956da19d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:41.392295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:41.393773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:41.394634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:41.398500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 171/343] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:41.399791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364d65-29f7-4d26-a692-559fb9a67865 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.400073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364d65-29f7-4d26-a692-559fb9a67865 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.400398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2364d65-29f7-4d26-a692-559fb9a67865 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.401908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 172/344] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:41.402844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2364d65-29f7-4d26-a692-559fb9a67865 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.440157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 12:26:41.441822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.442330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.442824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.462769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:41.464360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:41.523205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.562346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 174/346] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:41.563214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.580421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2364d65-29f7-4d26-a692-559fb9a67865 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.599592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.617865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.623665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.632668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 173/347] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:41.633773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.726966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea618d4-12d8-4b23-a78d-dcf884db8b64 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.772061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3125218-921e-4ccc-a671-e0881bcbb0f5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:41.795865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.798376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.798854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.799447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.801736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:41.806079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:41.808909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 175/348] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:41.811932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.821575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.842892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:41.844537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:41.845867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:41.846392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:41.866097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:41.872349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:41.873245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 12:26:41.874065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:41.876336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 174/349] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:41.877464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:41.953672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:41.972772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56779d0b-d1b8-464f-84f8-6585f9a55e7a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.011946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56301906-ffbe-4a35-9307-3bcb48c4606a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.017533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.019798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.020300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.025193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.057120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.058430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.058988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.059489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.067310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.068937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.070998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 175/350] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.071883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.118476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.119944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.135913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.206926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1b682-85af-4392-b47b-24c8cd853adb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.238538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.246851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.247495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.247771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.248044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.255080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 176/351] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:42.256114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.269071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-7d29d28f-db43-45ee-8645-2aeac7523760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:42.276294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:42.277354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:42.278365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:42.279033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 176/352] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:42.280151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27405d0e-edd0-4ffd-b294-0919440a2046 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.280429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27405d0e-edd0-4ffd-b294-0919440a2046 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.280699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27405d0e-edd0-4ffd-b294-0919440a2046 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.282085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 177/353] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:42.286617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27405d0e-edd0-4ffd-b294-0919440a2046 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.405227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9631e75-af67-4313-b832-9a5b67778a16 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.439015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27405d0e-edd0-4ffd-b294-0919440a2046 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.454036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.462083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.466500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.479099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 177/354] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.480031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.484261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.486205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.486585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.486810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.487600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.487913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.489403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.496933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 178/355] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.498120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.548117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.610441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4651ec4-040f-40eb-9ad1-e312a6aa713b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.614868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f55214-0418-4db7-aeef-4320f318a08d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.647557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.648171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.648444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.648717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.649384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:42.649685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.651097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36122c74-2d5a-49cb-991d-7b08139a7c3b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.660370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 179/356] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.661550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da76a54-a4a6-40f8-b664-5f311e5928a1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.661834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da76a54-a4a6-40f8-b664-5f311e5928a1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.662107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da76a54-a4a6-40f8-b664-5f311e5928a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.669093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.669743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.670018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.670321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.672414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.674482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.676223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 178/357] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.677159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.682878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0da76a54-a4a6-40f8-b664-5f311e5928a1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:42.684081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0da76a54-a4a6-40f8-b664-5f311e5928a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:42.716522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.771364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 180/358] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:42.772669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04241-810b-496c-8c57-134b20430e73 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.772953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04241-810b-496c-8c57-134b20430e73 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.773234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04241-810b-496c-8c57-134b20430e73 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.775151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 181/359] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:42.776303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec04241-810b-496c-8c57-134b20430e73 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.851128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca9e4-5d0a-4142-ac85-5e54588604d1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.875257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:42.901683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.902470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.902751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.903026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] PATH_INFO: `/v3/users/fa055a600b694b6f9805edbab3c8be6e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:42.904296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] RBAC: Authorizing `identity:get_user(user_id=fa055a600b694b6f9805edbab3c8be6e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:42.905900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:42.908031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 179/360] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/users/fa055a600b694b6f9805edbab3c8be6e => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:42.908929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:42.912438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec04241-810b-496c-8c57-134b20430e73 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:42.960298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:42.961321 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:42.961601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:42.962156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.001612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.030935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e49c7-a255-4e4b-9bc2-370fcface9cc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.058863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.060430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.073557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.074549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.075101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.075383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.076676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.079070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e561e-8a8a-4b3a-a931-009795b3d2ca None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.080889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 180/361] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.082412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.082696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.082974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.102896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:43.104464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:43.183301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.204525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 182/362] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:43.205517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.218147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 181/363] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:43.218147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.295305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.344704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ae877-0e74-4148-92ee-58328aa2a0b3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.362327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a6cce-967c-4112-98b6-7049b5eeec43 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.392425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.393552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.393831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.394100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.394887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] RBAC: Adding query filter params (role.id=fdcd71013b374d5bbfc7e20344176cf1, user.id=fa055a600b694b6f9805edbab3c8be6e, scope.system=all) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:43.395200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.396643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.409160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 183/364] 10.222.0.15 () {56 vars in 1308 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/role_assignments?user.id=fa055a600b694b6f9805edbab3c8be6e&scope.system=all&role.id=fdcd71013b374d5bbfc7e20344176cf1 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.410000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.421281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.422343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.422839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.423306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.448711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:43.454578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:43.455554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:43.456347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:43.460734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 182/365] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:43.462609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.522673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.608076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca01de-943e-4261-81c4-34e2ce7f251c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.613368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c544a-2753-4fbd-a688-9c29958aab66 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.644905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.657461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.658092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.658470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.658742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.659464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:43.659648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.659756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.660255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.660533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.660799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.661180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.662028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.663506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.665669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 183/366] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.666563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.668164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 184/367] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.670139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.802752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ff59b-9c25-4b24-9852-09911ff3df9d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.820811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.823773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c38e9-9021-49d1-bcaa-65b3694f0890 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:43.851769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.853110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.853613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.854259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.855508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:43.856209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:43.858636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:43.865365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:43.866003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:43.866740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:43.866740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:43.870947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 184/368] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:43.872180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.881969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:43.888947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:43.889826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:43.891060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:43.891700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 185/369] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:43.892019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:43.950546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:43.989735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a523e-b2c9-45eb-b461-01367707e4dc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.009813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df543637-ac99-464f-a463-f3166c6aea89 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.027420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.028056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.028338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.028610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.029718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.031191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.033195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 185/370] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.034684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.050813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.051699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.052115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.052536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.085433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.130807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.132861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.145682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586805e-8346-4ef0-9fff-0e7fc0fabb64 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.183322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.183983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.184200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.184463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.184561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.185119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.185480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.186892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.195711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 186/371] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.196444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.250737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 186/372] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:44.255273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.308914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a39eeb-afc3-4ed7-b5a8-2d4078da3697 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.311294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.355205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.355925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.356041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.356271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.357167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=35831b1e745d4a7090713d727e93e21d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:44.357477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.359392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.367719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 187/373] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.368984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.376294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328727e-b55e-45e3-a700-98ef872451bf None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.439838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.445279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.445906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.446416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.483219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.563504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.566603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.577059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eed39-1a85-427e-8d77-64daea36fca5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.621978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.622576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.622857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.623129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.624261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.625697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.628205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 188/374] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.638890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.679666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.687906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 187/375] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:44.694349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.762601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.790964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8fb5-6359-4150-a7fb-b8a1d053f1a9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.803500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ac49d-1765-49ed-9dfd-d2d0d5b9aa37 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.845721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.845957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:44.846463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.846740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.847010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.847524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:44.847985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:44.848191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.848634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] PATH_INFO: `/v3/projects/2da9e1885c75493abe2144dd979376b4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:44.849693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.850172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=2da9e1885c75493abe2144dd979376b4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:44.851473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 189/376] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:44.852025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:44.858303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.860735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 188/377] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/projects/2da9e1885c75493abe2144dd979376b4 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:44.867023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:44.972635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e610e7-f759-40d1-a01c-caf3c704c884 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:44.975032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:44.989813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa44e57-8116-461d-a717-395cccbfc5f9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.010791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.011488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.012186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.012837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.013439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.015907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=35831b1e745d4a7090713d727e93e21d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:45.015907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.018305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fab19-949a-4a22-a7a1-6b4ab1354943 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.025767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 190/378] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.026163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe55df-bdd3-4a82-aaf7-6c40d79925a4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.028359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe55df-bdd3-4a82-aaf7-6c40d79925a4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.028743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe55df-bdd3-4a82-aaf7-6c40d79925a4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.030558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 191/379] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:45.038307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.038307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.038307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.040203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.040866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.041149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.041423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] PATH_INFO: `/v3/groups/8ceabc439a5f44ad802ac1109b9417c2` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.058970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] RBAC: Authorizing `identity:get_group(group_id=8ceabc439a5f44ad802ac1109b9417c2)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.059544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:45.060459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.060864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:45.062528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 189/380] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:44 2022] GET /identity/v3/groups/8ceabc439a5f44ad802ac1109b9417c2 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:45.069607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.180000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 192/381] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:45.205340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034758-13b3-497a-9c1e-1aff2cf6cbfc None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.240373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.240914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.241196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.241473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.242205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] RBAC: Adding query filter params (group.id=8ceabc439a5f44ad802ac1109b9417c2, role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=2da9e1885c75493abe2144dd979376b4) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:45.242548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.243954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.249824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 190/382] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/role_assignments?group.id=8ceabc439a5f44ad802ac1109b9417c2&scope.project.id=2da9e1885c75493abe2144dd979376b4&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:45.499707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.619525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.623694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182d40-4035-4e74-aef4-b8f4d60f2b7e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.662632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.663274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.663609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.663882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.677365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:45.682124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:45.683016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:45.683799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 193/383] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:45.689472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:45.770168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:45.843526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d34b-d40a-40b3-bf55-cefa0bd93f9d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:45.879637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:45.880610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:45.881080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:45.881542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:45.882408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:45.882917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:45.884478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0452-2e57-4d67-9ab9-566fa9ef3cd5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:45.899209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 191/384] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:45.903967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.056593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2524ca-c36b-4214-8bab-99c8f4d58715 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.078777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445e26-d0e9-44bd-8c1b-1ee3aa6dade9 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.079419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445e26-d0e9-44bd-8c1b-1ee3aa6dade9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.079894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445e26-d0e9-44bd-8c1b-1ee3aa6dade9 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.081590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 192/385] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:46.089474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.090043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.090551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.105743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.106417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.106690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.106961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.110203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:46.110203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:46.111596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 194/386] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:45 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:46.118201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.129575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:46.131098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:46.160613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:46.251343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 193/387] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:46.280259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a7254-9b6c-46ae-8549-255bed395511 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.325409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.325969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.326280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.326559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.330893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:46.332359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:46.334319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 195/388] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:46 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:46.340106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.390563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:46.468899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0d161-2deb-4e89-bdec-19a41efc871e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.509013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.509682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.509956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.510249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/groups/6953324145fe41b6b7149da716c4c40c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.512138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, group_id=6953324145fe41b6b7149da716c4c40c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:46.513571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:46.584902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.602694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 194/389] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:46 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/groups/6953324145fe41b6b7149da716c4c40c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:46.699400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:46.707970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe849-17de-4aa5-a439-94cc525d4588 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.755126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.756206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.756688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.757163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.771475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:46.776942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:46.777805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:46.778644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:46.780860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 196/390] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:46.787564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:46.911105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:46.920700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634eb49-b8a5-4f11-aad7-bed8fbed6fea None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:46.958845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:46.959751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:46.960203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:46.960695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:46.961581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:46.962082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:46.963694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:46.974074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 195/391] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:46.981636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.104655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa650f-5afc-4cb0-9ec5-6d799acbb094 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.146312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.146948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.147222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.147490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.148591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:47.150028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b72ee-75ce-48ef-b303-ea45051b8fa7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:47.151930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 197/392] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:46 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:47.158929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.180250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86bd-d1be-42dd-9100-6547328d88c1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.180549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86bd-d1be-42dd-9100-6547328d88c1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.180725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f86bd-d1be-42dd-9100-6547328d88c1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.183670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 198/393] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:26:47.191479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.191479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.191479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.224864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:47.227651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:47.273275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.346310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f87ada-82ed-47ec-99cf-e9bbe60854b7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.367765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 199/394] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:47.384807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.385764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.386267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.386733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.388107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:47.389749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747198f-854d-4035-b41e-edb5a3e1054f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:47.393884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 196/395] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:47.397956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.536349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0205-3ebb-4480-a72e-599ee7257140 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.536646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0205-3ebb-4480-a72e-599ee7257140 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.536904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0205-3ebb-4480-a72e-599ee7257140 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.539735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f93e7-cd59-444c-bf41-7da6a20113e0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.542313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 197/396] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:47.544290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.544573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.544847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.563037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:47.564217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:47.598531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.599052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.599231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.599470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.599737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/groups/6953324145fe41b6b7149da716c4c40c/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.606080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] RBAC: Authorizing `identity:create_grant(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1, group_id=6953324145fe41b6b7149da716c4c40c, role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:47.607554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:47.666344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 198/397] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:47.685832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.694547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 200/398] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:47 2022] PUT /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1/groups/6953324145fe41b6b7149da716c4c40c/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:47.804558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036f123-56bb-4a4f-8d10-5b5ba833f41c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:47.849714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:47.850402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.850684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.851006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.865435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-ab97a0db-8f1e-4246-9905-fa6c78ee5de2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:47.870492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:47.871444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:47.872258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:47.878584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 199/399] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:47.879587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:47.911317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:47.970274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7af3f-3820-40f7-b8c1-e13c8fc6a285 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.970591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7af3f-3820-40f7-b8c1-e13c8fc6a285 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.971408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7af3f-3820-40f7-b8c1-e13c8fc6a285 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:47.973008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 200/400] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:47.977870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:47.978148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:47.978467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.001319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:48.003458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:48.024550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed7ca0-a518-4791-a02c-379db7457340 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.026549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.069830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.070454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.070734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.071006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.071666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:48.072496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.074251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.087178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 201/401] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.088071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.088835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 201/402] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:48.093562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.236937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.239747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8f98-a0d6-4596-a682-8a96c42da045 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.282329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.282973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.283769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.286697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.287738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.294203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.296168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 202/403] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.300899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.303166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d5cd-a026-414b-ba06-a0046197bac8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.332403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.367069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.367727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.368007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.368281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.381730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:48.388368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:48.389226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:48.389989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:48.390617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 202/404] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:48.391917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.440157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243485-800f-43b0-b4be-498dabcfb293 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.483045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.483684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.483960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.484232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.485361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.488038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.490503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 203/405] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.491403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.522437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9076-9949-4b75-97ba-4319aef667ab None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.563773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.564411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.564720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.565155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.567427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.576918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:48.584222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:48.586151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 203/406] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:48.587664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.609044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:48.634813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721ddec-654d-442d-9711-fade29203dfd None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.680667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.681709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.682540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.682989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.683803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:48.684247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.686288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.697665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 204/407] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.698889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.699302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5b2c-e1b5-4ef9-9b87-a730ba3ae9ab None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.739442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.740072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.740539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.740894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/groups/6953324145fe41b6b7149da716c4c40c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.743143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, group_id=6953324145fe41b6b7149da716c4c40c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.744702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.815124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f9879-e494-4edd-81f0-83b79b036e2d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:48.850407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 204/408] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:48 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/groups/6953324145fe41b6b7149da716c4c40c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:48.856855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:48.856855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:48.856855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:48.856855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:48.863783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:48.863783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:48.863783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:48.864016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.865734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 205/409] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:48.874450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:48.877969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.016096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.078891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77155d4-0484-4893-b4a7-ee1b90830ddd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.096974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af410-3c7b-42ed-83c4-5c8844ecda6b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.116177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.116678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.116960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.117228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.119865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.121359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.123052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 205/410] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.129037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.141565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.142981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.143544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.144239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] PATH_INFO: `/v3/groups/8ceabc439a5f44ad802ac1109b9417c2` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.146151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] RBAC: Authorizing `identity:get_group(group_id=8ceabc439a5f44ad802ac1109b9417c2)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.148062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.150702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 206/411] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:48 2022] GET /identity/v3/groups/8ceabc439a5f44ad802ac1109b9417c2 => generated 229 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:49.159746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.254808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.270821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc86aed-80bf-43ed-96d2-93457bc10c4e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.293945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32379-aa27-4295-b4c3-088158b1f57b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.307358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.323474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.324482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.325532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.326013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.328002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.331706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5981c23-0a28-4f59-8470-fd20dc82a180 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.334991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 206/412] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:49.336351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957c3d-4573-4d9a-ab7f-956297db2b21 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.336898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957c3d-4573-4d9a-ab7f-956297db2b21 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.337388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957c3d-4573-4d9a-ab7f-956297db2b21 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.339103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 207/413] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:49.343625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957c3d-4573-4d9a-ab7f-956297db2b21 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.350094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.351000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.351483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.351959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] PATH_INFO: `/v3/projects/2da9e1885c75493abe2144dd979376b4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.353310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] RBAC: Authorizing `identity:get_project(project_id=2da9e1885c75493abe2144dd979376b4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.354984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de028a-7c89-4e61-a346-ddfd442dca8a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.356810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 207/414] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/projects/2da9e1885c75493abe2144dd979376b4 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:49.358298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.358781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.359271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.378348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:49.379840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:49.458414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957c3d-4573-4d9a-ab7f-956297db2b21 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.458801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 208/415] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:49.460312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.494204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.494204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.494204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.494204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d/groups/6953324145fe41b6b7149da716c4c40c/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.494603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] RBAC: Authorizing `identity:create_grant(project_id=35831b1e745d4a7090713d727e93e21d, group_id=6953324145fe41b6b7149da716c4c40c, role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.495777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.551080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.584579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275ddd9-e95b-4e2d-841a-92f20a2fbe8c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.612630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:49 2022] PUT /identity/v3/projects/35831b1e745d4a7090713d727e93e21d/groups/6953324145fe41b6b7149da716c4c40c/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:49.632818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.633408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.633687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.633956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] PATH_INFO: `/v3/projects/2da9e1885c75493abe2144dd979376b4/groups/8ceabc439a5f44ad802ac1109b9417c2/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.636465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] RBAC: Authorizing `identity:create_grant(project_id=2da9e1885c75493abe2144dd979376b4, group_id=8ceabc439a5f44ad802ac1109b9417c2, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:49.638007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa12a5e-fa3f-4d02-8eab-f1d0487c8adf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:49.704607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 209/417] 10.222.0.15 () {58 vars in 1442 bytes} [Mon Aug 22 12:26:49 2022] PUT /identity/v3/projects/2da9e1885c75493abe2144dd979376b4/groups/8ceabc439a5f44ad802ac1109b9417c2/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:26:49.770550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:49.829450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:49.893884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb636-e017-4c36-8cda-acdb44b86fbf None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:49.930621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d5bb-6d30-494b-af92-b1b8a0fed37c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.930934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d5bb-6d30-494b-af92-b1b8a0fed37c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.931162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9d5bb-6d30-494b-af92-b1b8a0fed37c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.932882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 210/418] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:49.938977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:49.939345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.939653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:49.939756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.939932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:49.940028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.940206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:49.952867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:49.958539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:49.959429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:49.960348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 209/419] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:49.963348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:49.964815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:49.967367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.081625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 211/420] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:50.144769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2988898-6dbf-46f2-b4bc-5b025b8cf9ae None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.165763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.198207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.198833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.199104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.199370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.200049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:50.200345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.201751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.217785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 210/421] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:50.223375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.336702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.393859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364e0a4-a0a5-4de6-8a65-431eab5ecbda None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.439022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.439632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.440402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.440674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.465900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.540246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.541717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.626615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.685368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc1449-483e-445d-9930-cbff9e3c474e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.707431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 212/422] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:50.713220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.743594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.744597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.745069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.745531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.757987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:50.763676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:50.764644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:50.765468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:50.768752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 211/423] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:50.774526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.826591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:50.883248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b67cd-0bbb-4d9f-a9e0-07e05eee0388 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.887700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874be3e-b69d-4be0-9fd3-9f4a7e4ed03d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:50.921774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.922886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.923362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.923871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.924782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:50.925274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.926962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.935857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 212/424] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:50.941700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:50.958547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:50.959204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:50.959398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:50.959678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:50.967214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:50.968489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:50.970474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 213/425] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:50.976021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.024215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.052109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35740171-0039-482b-90ca-aeb17f651897 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.055301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.088578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.089533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.090008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.090508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.153441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42239-842e-45f8-8088-a5dfced45245 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.196878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.199427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.219781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.220855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.221842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.222376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.225087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.226738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.229340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 214/426] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:51.235154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.350279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.350833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 213/427] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:51.352636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.379917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.385846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660876-8e6b-4ad9-acb5-4551d9fc4f02 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.434010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.434971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.435261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.435541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.436537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:51.436859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.438472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d9a5f-6235-461c-aeb1-e1d7a44fa1d5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.450471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 215/428] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.452284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742b73-4fdf-4db7-b32d-4dedb4670634 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.452771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742b73-4fdf-4db7-b32d-4dedb4670634 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.453240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79742b73-4fdf-4db7-b32d-4dedb4670634 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.458000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 216/429] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:51.465967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.466607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.467117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.478062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff3f2-5233-4aab-b38a-0c04d1e4b199 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.501649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:51.503803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:51.558822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.559466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.559739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.560010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] PATH_INFO: `/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.561169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] RBAC: Authorizing `identity:get_project(project_id=1554ef0cf35b4a7f80c9dcd94233b7e1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.562654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.574208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 214/430] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/projects/1554ef0cf35b4a7f80c9dcd94233b7e1 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.579512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.622100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 217/431] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:51.669193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.710018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577e77-8802-4579-a94c-86a6c123165c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.746913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.747909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.748401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.748864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.750196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.751946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6734ea1-55d1-4371-8d42-83ce48500d31 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.754249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 215/432] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.760348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.857655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:51.868445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438ace-3b02-44c7-926d-7a8d60b26ca6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:51.905157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:51.906136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.906625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.907091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.908000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:51.908574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:51.910197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7240c94-7133-4350-b7a4-0938113bd9d4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:51.916732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 218/433] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=1554ef0cf35b4a7f80c9dcd94233b7e1&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:51.937858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9de7-f3b4-4cbe-879c-c4e500c6c56a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.938845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9de7-f3b4-4cbe-879c-c4e500c6c56a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.939382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9de7-f3b4-4cbe-879c-c4e500c6c56a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.941017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 216/434] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:51.956628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1213-a2e9-4ad1-9c02-402b7bee924d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:51.957240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1213-a2e9-4ad1-9c02-402b7bee924d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:51.957709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f1213-a2e9-4ad1-9c02-402b7bee924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:51.960156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c9de7-f3b4-4cbe-879c-c4e500c6c56a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:51.981942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-838f1213-a2e9-4ad1-9c02-402b7bee924d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:51.983916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-838f1213-a2e9-4ad1-9c02-402b7bee924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:52.082101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 219/435] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:52.108431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c9de7-f3b4-4cbe-879c-c4e500c6c56a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.114945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121026af-f953-40e1-8f8b-1621289a6b4d None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.115227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121026af-f953-40e1-8f8b-1621289a6b4d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.115501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121026af-f953-40e1-8f8b-1621289a6b4d None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.117161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 220/436] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:52.122545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.122824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.124653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.142949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:52.144473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:52.146052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.151856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.155541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.155541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.155541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.167263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:52.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:52.172952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:52.175254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 217/437] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:52.179600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.253706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 221/438] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:52.309569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0835e9-55c5-49bc-98ec-b1df96c6cbd2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.357670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.358326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.358611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.358881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.359550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.359849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.361261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.372273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 218/439] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:52.379907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.389355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.403241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.455784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.513776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bcc9b-78c5-4244-8e38-ac9331b6d8fc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.525972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7b768-6dde-4c22-8829-083a5311991d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.556707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.557336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.557610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.558000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.567756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.568360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.568638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.568728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:52.568911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:52.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:52.574744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 219/440] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:52.576523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.637222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.638635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.652946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.675279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50f211-9817-456e-b28b-a3f5c7e88d36 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.687761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.709208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.709824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.710103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.710406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.720494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:52.726049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:52.726947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:52.727765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 220/441] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:52.728420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.740901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 222/442] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:52.741748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.826065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378463ee-6e70-4e9a-9868-b926ebaa0471 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.841920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac0e85-9211-41bf-ad95-b1e86d92f6bb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.855222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.858989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.862129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.862129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.862129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.862129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.862129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.862486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.870204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 221/443] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.870979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.875245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:52.875842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:52.876113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:52.876401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:52.877646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:52.877951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:52.879774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:52.887910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 223/444] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:52.888632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:52.908086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:52.973005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1da8a-19e8-48d7-8263-f94bb481d051 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:52.984576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19048991-4df9-44a1-aa8d-7aba98895782 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.007492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.008094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.008363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.008628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.009722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.011172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.012746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 222/445] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.013479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.021225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.021827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.022106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.022802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.067629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.089114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.090588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.111964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d9a20-3257-4674-ab02-25680418d40e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.113498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.145651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.146207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.146496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.146799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.188065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 224/446] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:53.188899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.214925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.216380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.264026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.287452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c45530-b8f1-4623-b7f2-116f47fa3f02 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.313639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 223/447] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:26:53.314579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.316778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.325607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.326261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.326537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.326807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.327899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.329702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.334495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 225/448] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.336636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.413141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2e380-56d1-4905-bcf0-883695955206 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.437774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca2437-5c7a-4f34-a70b-ac03c5cd9a66 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.445800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.446455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.446733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.447002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] PATH_INFO: `/v3/projects/2da9e1885c75493abe2144dd979376b4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.448114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] RBAC: Authorizing `identity:get_project(project_id=2da9e1885c75493abe2144dd979376b4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.449529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.451169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 224/449] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/projects/2da9e1885c75493abe2144dd979376b4 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.451924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.472585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.473307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.474056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.474466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] PATH_INFO: `/v3/projects/35831b1e745d4a7090713d727e93e21d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.475618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=35831b1e745d4a7090713d727e93e21d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.477045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.478701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 226/450] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/projects/35831b1e745d4a7090713d727e93e21d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.479457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.497047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.522004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.550973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc34ab-c24b-4662-9074-2ffdee9ba839 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.581907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccb35-897c-4afe-bc70-28cb22c1b3d2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.585870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.586499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.586780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.587055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.587772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=2816f759300c43c69378fdf8eaca6e20, scope.project.id=35831b1e745d4a7090713d727e93e21d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.588079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.589518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.595285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 225/451] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=2816f759300c43c69378fdf8eaca6e20 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.596289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.617878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.618569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.618849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.619119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] PATH_INFO: `/v3/groups/8ceabc439a5f44ad802ac1109b9417c2` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.620972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] RBAC: Authorizing `identity:get_group(group_id=8ceabc439a5f44ad802ac1109b9417c2)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.622983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.625547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 227/452] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/groups/8ceabc439a5f44ad802ac1109b9417c2 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.632019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.717862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cdead-81dd-41d5-98d3-f4a178be033a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.742401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.760653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.760653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.760653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.761006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] PATH_INFO: `/v3/groups/6953324145fe41b6b7149da716c4c40c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.763143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] RBAC: Authorizing `identity:get_group(group_id=6953324145fe41b6b7149da716c4c40c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.764403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.764959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac1ff-2dfc-4ec0-80ae-0c86a20a3a35 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.766022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 226/453] 10.222.0.15 () {56 vars in 1180 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/groups/6953324145fe41b6b7149da716c4c40c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:53.772579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:53.776780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:53.811051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.811755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.812099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.812379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.813100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] RBAC: Adding query filter params (group.id=8ceabc439a5f44ad802ac1109b9417c2, role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=2da9e1885c75493abe2144dd979376b4) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.813404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.815481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1d5b-858a-4e0b-beb4-0e39c92490ca None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.826222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 228/454] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/role_assignments?group.id=8ceabc439a5f44ad802ac1109b9417c2&scope.project.id=2da9e1885c75493abe2144dd979376b4&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:53.903843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b39a-b6b5-455d-b019-e3bc9ffca735 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:53.943532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:53.944153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:53.944434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:53.944707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:53.945448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] RBAC: Adding query filter params (group.id=6953324145fe41b6b7149da716c4c40c, role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=35831b1e745d4a7090713d727e93e21d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:53.945758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:53.947264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8f6c-053b-4277-86a3-7124ff744369 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:53.954420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 227/455] 10.222.0.15 () {56 vars in 1376 bytes} [Mon Aug 22 12:26:53 2022] GET /identity/v3/role_assignments?group.id=6953324145fe41b6b7149da716c4c40c&scope.project.id=35831b1e745d4a7090713d727e93e21d&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:56.338050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f92-a320-477b-9b57-4e9526333083 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.338592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f92-a320-477b-9b57-4e9526333083 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.338700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f92-a320-477b-9b57-4e9526333083 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.339984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 229/456] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:56.346360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482dc-0619-435c-b88e-9a8356ac4ccc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.346783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482dc-0619-435c-b88e-9a8356ac4ccc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.346979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482dc-0619-435c-b88e-9a8356ac4ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.369361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-118482dc-0619-435c-b88e-9a8356ac4ccc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:56.370584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-118482dc-0619-435c-b88e-9a8356ac4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:56.458811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:56.466779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 228/457] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:56.514507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466314f-2a35-4fb2-ae8a-2c14560aee56 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.515130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466314f-2a35-4fb2-ae8a-2c14560aee56 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.515634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466314f-2a35-4fb2-ae8a-2c14560aee56 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.517392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 230/458] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:56.522877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6d64-48d6-4307-9e80-19e4bab2426a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.523395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6d64-48d6-4307-9e80-19e4bab2426a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.523888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e6d64-48d6-4307-9e80-19e4bab2426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.542889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c79e6d64-48d6-4307-9e80-19e4bab2426a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:56.544348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c79e6d64-48d6-4307-9e80-19e4bab2426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:56.629981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 229/459] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:56.710047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe27a-6038-47af-a380-33f34ec3188b None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.710699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe27a-6038-47af-a380-33f34ec3188b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.711191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe27a-6038-47af-a380-33f34ec3188b None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.712965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 231/460] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:56.718287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770116-179b-4006-b8a2-116122355ea7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.718798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770116-179b-4006-b8a2-116122355ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.719290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770116-179b-4006-b8a2-116122355ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.738459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-36770116-179b-4006-b8a2-116122355ea7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:56.740038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-36770116-179b-4006-b8a2-116122355ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:56.766802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe27a-6038-47af-a380-33f34ec3188b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:56.809733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 230/461] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:56.879780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe27a-6038-47af-a380-33f34ec3188b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:56.933707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:56.934689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:56.935143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:56.935585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:56.949743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:56.951414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:56.956612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:56.969028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:56.969918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:56.970881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:56.970881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:56.970881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:56.972739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 232/462] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:56.978701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36770116-179b-4006-b8a2-116122355ea7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.027256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.084371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.168395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3b82-ab2c-448d-9516-3569585bf822 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.204798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36770116-179b-4006-b8a2-116122355ea7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.218679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.219442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.219726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.219999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.248625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.250232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.264425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.271447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.271447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.271447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:57.271765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:57.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:57.273382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:57.273382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.273382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:57.273382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 233/463] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:57.273382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.273638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:57.273638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.273638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.330961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 231/464] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:57.331576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.334553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.427283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6153a3-2a6e-4370-8c50-a24b940c9bf7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.486753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.487576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.488205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.488584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.501111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.503414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:57.520906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:57.521820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:57.522684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:57.522684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:57.522684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:57.530203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 234/465] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:57.530203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.538988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6e11-5992-4454-9876-eb05c2ead1cf None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.584478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.611996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.612525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.612803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.613303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.613700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:57.613996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.615400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.627467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 232/466] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:57.628291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.655480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.659163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8df29-7cf8-4049-834e-0d34ed9cb742 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.696773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.697403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.697686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.697964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.698643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.702108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.739941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd13ac7-e47d-4c16-97ab-89debc306016 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.774085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.774769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.775073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.775344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.775973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:57.776272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.777644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0989b-1e29-460a-9537-a0d9c2e2d4fe None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.789899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 233/467] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:57.791075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb7e6-f230-41d7-8d99-f125d559f3fb None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.791356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb7e6-f230-41d7-8d99-f125d559f3fb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.791626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cb7e6-f230-41d7-8d99-f125d559f3fb None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.794474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 234/468] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:57.795398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cb7e6-f230-41d7-8d99-f125d559f3fb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.805055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 235/469] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:57.806585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:57.836474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:57.915983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cb7e6-f230-41d7-8d99-f125d559f3fb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.949870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2aecc-12fc-48f5-af41-bb03273097ac None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:57.963626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.964447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:57.964837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:57.965130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:57.965897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:57.967671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08d5a-522e-4a88-9d62-7279fa18528a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:57.995663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:57.996275 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.003903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.003903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.003903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.003903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a7e2-8c36-433f-aeda-0e416da9d59a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.093483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 235/470] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:58.094771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.095019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.095287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.116112 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:58.117377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:58.145383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 236/471] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:57 2022] POST /identity/v3/users => generated 248 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:26:58.150028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ec15a-5ff6-4953-9e1e-5dfd352a612c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.150028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ec15a-5ff6-4953-9e1e-5dfd352a612c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.150028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ec15a-5ff6-4953-9e1e-5dfd352a612c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.150028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 237/472] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:26:58.156888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.157223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.157445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.210376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:26:58.210376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:26:58.220176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.238480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 236/473] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:26:58.308526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 238/474] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:26:58.559704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.591089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.592255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.708592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0680f43-6dd2-4350-801e-102ff115adcd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.774490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f09b0-107b-4e15-9bc7-5a6d59b31dba None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:58.785388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.786125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.786422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.786688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.808006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.809477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.816072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:58.816625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:58.816902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:58.817173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:58.817844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:58.819242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:26:58.838609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:58.842251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:26:58.843099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:26:58.843099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:26:58.843099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:26:58.843099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 237/475] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:58.846384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.867235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.sql.core [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:58.867235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 12:26:58.867235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [parameters: {'id': '82cb6b8c91db42438cfe2a75c54e8278', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 12:26:58.867235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81881) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result.read() Aug 22 12:26:58.891967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:26:58.894097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application yield resource Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise self.value Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application session.commit() Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:26:58.896389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:26:58.898654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:26:58.900734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result.read() Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:26:58.911028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [parameters: {'id': '82cb6b8c91db42438cfe2a75c54e8278', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:58.912822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 12:26:58.914529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:58.916535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 239/476] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 12:26:58 2022] POST /identity/v3/roles => generated 144 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:26:58.916535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:58.935385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.935975 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:58.964879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608af60-8ab8-4aca-8178-aa0a29e4ff6d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.005926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.006585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.006865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.007221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.007882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:59.008183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:59.009598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:59.039341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 238/477] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:26:59.045326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:59.108099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba09835-0ef9-4b87-abf1-142d0a14c388 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.174087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.174774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.175052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.175322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.202911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:26:59.209026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:26:59.209888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 12:26:59.210725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:26:59.216374 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 240/478] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:26:59.217203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:26:59.251369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f05-8645-48ae-aa47-5231ea32843e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.322548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:59.327715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.328568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.329244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.329665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.333322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:59.333322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d7486-6224-4bec-bb70-93ab2cb17152 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:59.350502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:26:59.380860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033a133-5173-405f-a67e-297e7eb1670c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:26:59.426425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:26:59.427401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:26:59.427874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:26:59.428368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:26:59.429663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:26:59.430204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:26:59.431779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24d8f9-f07e-4711-a6a4-3e77ee5d158f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:26:59.441707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 241/479] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:26:59.457015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 239/480] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:26:59 2022] POST /identity/v3/users => generated 249 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:00.013574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cd005-75ab-4929-9a3d-ec962bf740c2 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.014642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cd005-75ab-4929-9a3d-ec962bf740c2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.015125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cd005-75ab-4929-9a3d-ec962bf740c2 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.016982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 242/481] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:00.022901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e8ad-65cb-410c-8538-f734ff6428e8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.023367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e8ad-65cb-410c-8538-f734ff6428e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.023443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39e8ad-65cb-410c-8538-f734ff6428e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.051356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ea39e8ad-65cb-410c-8538-f734ff6428e8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:00.053001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ea39e8ad-65cb-410c-8538-f734ff6428e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:00.139237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 240/482] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:00.526894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cd005-75ab-4929-9a3d-ec962bf740c2 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:00.575647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c541-7b40-4c13-9424-6c9e4f30c3e5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.575954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c541-7b40-4c13-9424-6c9e4f30c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.576128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4c541-7b40-4c13-9424-6c9e4f30c3e5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.578255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 241/483] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:00.583441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b1ed-4282-40e9-b7de-f4f8f21d1f5f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.583830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b1ed-4282-40e9-b7de-f4f8f21d1f5f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.584425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26b1ed-4282-40e9-b7de-f4f8f21d1f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.606796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-be26b1ed-4282-40e9-b7de-f4f8f21d1f5f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:00.608285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-be26b1ed-4282-40e9-b7de-f4f8f21d1f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:00.663435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cd005-75ab-4929-9a3d-ec962bf740c2 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:00.691025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 242/484] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:00.692796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea122-294d-4582-81a5-a2d766489542 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.693235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea122-294d-4582-81a5-a2d766489542 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.693699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafea122-294d-4582-81a5-a2d766489542 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.695076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:00.699467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 243/485] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:00.702299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.703126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.704171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.708576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:00.709203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.709473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.713797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.722166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:00.725710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:00.727311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:00.728201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:00.729149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 243/486] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:00.730102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:00.735000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:00.805102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:00.858924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d4280-58c6-4727-8a81-b704a6323199 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:00.862921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 244/487] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:00.913927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:00.914674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:00.914960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:00.915233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:00.915991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:00.916302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:00.917733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:00.934695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 244/488] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:00.943276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.030341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.097447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.129120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a997c7-ca5f-4c39-8ce7-f0a7abf801a0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.153094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4e20-c939-453f-a8ac-101c4299f960 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.193598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.194257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.194687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.195018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.205572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:01.210876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.211752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.212542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:01.213138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.213138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.213138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.213138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.213383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 245/489] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:01.219729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.237773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.239279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:01.259090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.260027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:01.260888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:01.260888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.260888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:01.270940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 245/490] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.271877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.311005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.357256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a091a5-097e-486d-88da-9e12e85934f2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.371222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.385811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6030-a3e7-4074-8bf8-ad451fdadf78 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.402150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.403009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.403545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.404115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.405225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.405691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.407252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.418305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 246/491] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.419181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.432854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.434443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.434934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.435411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.449681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:01.457985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.459001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:01.459868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:01.462970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 246/492] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.464023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.535271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a7e6-0238-4522-bc48-9a62cac8a586 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.562153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.571512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.572242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.572439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.572718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.573103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f503b-4d5d-4c0f-ba65-23a7ab6dc8e4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.573368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.573670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.575159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.593436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 247/493] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.594365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.612030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.613344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.613990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.614499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.628115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.629520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.631364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:01.654108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.655058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:01.655907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:01.655907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:01.655907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:01.655907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 247/494] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.656587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.723912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329084b-3353-4662-9619-f38e332dee3d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.762619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.763580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.764116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.764612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.765460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.765958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.767611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.776179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2432-fe21-49c4-b3f8-c0a71b60c6c3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.776584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 248/495] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.777579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.813359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.813994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.814303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.815110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.822692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.824133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ea73d9b6-f42e-450e-8900-55ae1d498b38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:01.837788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:01.838953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:01.840101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:01.843570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 248/496] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:01.844753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6973ee-6d81-4254-a0b9-e8ba82a8bc5f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.845041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6973ee-6d81-4254-a0b9-e8ba82a8bc5f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.845315 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6973ee-6d81-4254-a0b9-e8ba82a8bc5f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.850613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 249/497] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:01.850613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6973ee-6d81-4254-a0b9-e8ba82a8bc5f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.851463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.887391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:01.895204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f079a63-3700-43e8-a405-475f82577591 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.931414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.931930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.932207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.932474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:01.933120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:01.933426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:01.934806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:01.946907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 249/498] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:01.947802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:01.957530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6973ee-6d81-4254-a0b9-e8ba82a8bc5f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:01.991187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:01.991803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:01.992078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:01.992349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.004123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.005609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a3a5d7e6-69f3-45a5-aaf7-fd90219d64cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:02.019855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.020953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:02.021802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:02.021802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.021802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:02.021802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 250/499] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.022127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729697e7-bada-4589-aa66-a019e669612b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.022325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729697e7-bada-4589-aa66-a019e669612b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.022596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729697e7-bada-4589-aa66-a019e669612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.040163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-729697e7-bada-4589-aa66-a019e669612b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:02.041370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-729697e7-bada-4589-aa66-a019e669612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:02.050622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8ce3c-c689-4441-a91c-b551e05dc332 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.083717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.084316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.084592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.084864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.085575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.085875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.087338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139b63a-16cb-4674-85ba-d458f153fadf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.091809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.108194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 251/500] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:02.109020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729697e7-bada-4589-aa66-a019e669612b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.140341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 250/501] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.140341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ef9b-35e6-42aa-88e9-67e8e0337593 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.140341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ef9b-35e6-42aa-88e9-67e8e0337593 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.140341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7ef9b-35e6-42aa-88e9-67e8e0337593 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.145728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 251/502] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:02.145728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7ef9b-35e6-42aa-88e9-67e8e0337593 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.159648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.229018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729697e7-bada-4589-aa66-a019e669612b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.251851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7ef9b-35e6-42aa-88e9-67e8e0337593 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.270378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.271097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.271379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.271652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.278794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.280240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.290150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.290778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.291052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.291316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.291943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.292235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.293702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4fcd-3408-47d0-a331-04fae9e60538 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:02.294133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.295018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:02.295943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 252/503] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.297141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.308889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 252/504] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.310038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.310418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.310633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.329305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:02.331034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:02.353145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.399178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 253/505] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:02.400017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.402253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.419553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c14f68-63c4-43fa-a3e7-2fd5bc36c405 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.455602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.456208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.456488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.456758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.506905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c07e-8183-4a80-a50a-99c8cdf20806 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.526848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.528494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.542741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.543719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.544005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.544500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.545150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:02.545452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.546972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.571266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 254/506] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:02.571266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.580206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.631543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.641769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 253/507] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:02.641769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.675500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274fc8-7ca5-4217-b5d5-6583687ec1b1 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.712243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.712873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.713155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.713155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.723320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.724758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:02.737849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 255/508] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.739948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.750938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c266-cf82-4836-b1e2-20939b33e9c7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.785497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.786115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.786414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.786676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.796351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.797795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.804935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:02.812716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.819139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:02.820155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:02.820155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.820155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:02.820155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 254/509] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.820155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:02.838317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c890bf-1446-4c52-a9a6-df704c8f274a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.857727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:02.871902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.872495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.872771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.873042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.917600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd455e7f-85e7-4bcb-b7d4-4340b271821a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:02.939414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.940868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.950124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:02.950760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:02.951033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:02.951300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:02.962610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:02.964031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:02.977988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:02.978948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:02.979792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:02.979792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:02.979792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:02.979792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 255/510] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:02.980023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.032432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.046302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 256/511] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:03.046302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.065513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.083944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615600b-59eb-4b7a-82af-b1ce59d98b59 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.117870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.118533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.118808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.119077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.129103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:03.134220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.135284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 256/512] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.136457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.145252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99e30-5075-478a-afc8-18d896a3f192 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.179447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.180344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.180624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.180900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.181616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.181915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.183371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.202745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 257/513] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.203560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.242610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b3955-f4af-4b7a-acc0-a40028f3b854 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.253236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.277869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.278683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.279122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.279731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.280372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.280665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.280982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.282032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.295499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 257/514] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.296366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.302399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae06d6-78e9-408b-9f4c-128c0dbade38 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.337651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.338271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.338544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.338809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.339436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.339735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.341078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.352033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 258/515] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.352657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.398441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda8329-08cc-41ed-860e-0f9c3e0d6651 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.440614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.441565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.441844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.442223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.452212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.454003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.464529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286c61-4a25-4e42-b595-3aa1e84e4478 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:03.468898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.469804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:03.470821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:03.470821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:03.470821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:03.470821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 258/516] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.470821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.498621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.498835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.499780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.500058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.500328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.500983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.501281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.503176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.508233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.511713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 259/517] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.512472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.574737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588dd91-55ce-4295-ba49-56a845a1238c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.608718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.609314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.609590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.609857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.609974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17372e-2b1d-4eb2-a48d-201be9bdad23 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.644270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.644860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.645131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.645400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.646015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.647478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.678436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.679943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.703288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.734212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 260/518] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:27:03 2022] POST /identity/v3/users => generated 247 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:03.734212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.785719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.789593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 259/519] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:03.790699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.840707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897836fb-c026-4d9c-acc3-c0d0bc4ca1a2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.880585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.881319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.881603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.881878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.889511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.890750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:03.904203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:03.905107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:03.905990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 261/520] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:03.906961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:03.918336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0d5ad-8358-4d76-a995-1c4d04488206 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:03.942550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:03.954479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:03.955699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:03.955978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:03.956443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:03.957162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:03.957528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:03.959032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:03.970503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 260/521] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:03.971376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.021484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28debd9-0e48-4c12-8e1d-63cace11bedc None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.039322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.056689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.057322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.057599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.057858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.070977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.076573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.084598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad31bab-acf2-48c9-9472-6d3728b2f18a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:04.089779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.091050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:04.091915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:04.091915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:04.091915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:04.091915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 262/522] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.091915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.125252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.125874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.126157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.126666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.138089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.139597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:04.154145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.155100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:04.155935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:04.155935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:04.155935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:04.155935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 261/523] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.156247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.193672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.204712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc944a8-af5a-4b72-8012-b82bda396e4d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.241078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.241678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.241959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.242252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.242937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.243236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.244639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.263483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 263/524] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.264626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.273450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92889-5192-4f8c-bbf3-a87c2922efb8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.298174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.311316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.311944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.312222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.312499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.319407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.320856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:04.332733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.333591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:04.334481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 262/525] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.335044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.385936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e36bc-d155-4dd6-a660-f1567cea65df None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.423388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.424132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.424411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.424956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.425428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.425727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.427136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.432927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.439593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c3286-baa3-4de4-82b2-6f62bb7235e0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.444413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 264/526] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.445279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.474145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.474759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.475090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.475364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.476005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.476303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.477656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.489833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 263/527] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.490636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.542074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.558795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc3630-26a7-4d4c-b1fd-b3562eff327d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.596554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111c3b-2d80-41ac-abc6-3207b93dee57 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.598048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.598699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.599622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.599622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.599982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.600276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.601704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.618242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 265/528] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.618242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.635407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.636095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.636635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.636915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.637918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.638242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.639896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.670377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 264/529] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.671286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.692357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.762121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc71ac6-5a47-4bec-9bd6-141943336c6f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.805526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14b36e-75aa-4a36-95c3-25351a46efe5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.806015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.806847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.807422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.807834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.820386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.821857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:04.834870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.835998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 266/530] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.836939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.852669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.856614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.857563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.858431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.858858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.868428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.870569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:04.886550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:04.887581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:04.888643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:04.890989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 265/531] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:04.892061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:04.950322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6077c3-5daf-49da-ad93-fc019276970b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:04.986310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:04.987078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:04.987455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:04.987825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:04.988641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=384e6654dbac4182900d6326eb23182b) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:04.989045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:04.990348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:04.991682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:04.997826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 267/532] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/role_assignments?user.id=384e6654dbac4182900d6326eb23182b&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:04.998875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.041925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40cbf2-1f8a-45c6-ad80-f4e2d4a33e71 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.106762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.107394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.107666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.107931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.108756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:05.109063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.111615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.153555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.178565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:05.184923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.200901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdb07e-215f-485c-9715-6c7d43d2ae47 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.238168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.239042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.239489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.239903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.240737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:05.241194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.242786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.255974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 268/534] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:05.261513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.341301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c9c8-7e44-41f1-af2d-f429e70d5f68 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.374607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.380473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.381255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.381677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.382121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.458864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.460669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.571576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 267/535] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:05.587124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717dd4a-4a7c-4770-b1da-8f1f6236182b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.588406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.630620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.630620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.630620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.630620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.630991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f21a5d7a9a2043adb471333fd3589f0d) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:05.630991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.630991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ea17b-8879-4104-bc56-ed49a0514a57 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.632427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 269/536] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/role_assignments?user.id=f21a5d7a9a2043adb471333fd3589f0d&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:05.634508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.650735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:05.740058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf37fe-252a-4546-9d70-05d13ef7f45a None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.740339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf37fe-252a-4546-9d70-05d13ef7f45a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.740507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf37fe-252a-4546-9d70-05d13ef7f45a None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.741881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 270/537] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:05.747859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.748084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.748481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.766827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23978162-332d-4483-aeb7-1d862530f5e7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:05.774203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:05.774203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:05.815731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:05.816369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:05.816644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:05.816914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:05.828098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:05.830022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:05.846843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:05.847752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:05.848591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:05.848591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:05.848591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:05.848591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 268/538] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:05.849889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 271/539] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:05.853817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:05.988062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.008559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277559c8-6025-4d78-a4d2-7d531efcc649 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.054893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.055487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.055765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.056035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.056672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.056972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.058362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.073476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 269/540] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:06.078659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.159121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.266276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabdbe0-921e-4e48-9996-bc5ae4db61e3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.267638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34c1a2-48ca-44e0-8de5-922805cc10b7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.316077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.316719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.316996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.317263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.329213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.337654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:06.343518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:06.344927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:06.346931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 270/541] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:06.351079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.351767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.352051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.352330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.359920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.362216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.363666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.382549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:06.387754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:06.389807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 272/542] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:06.398761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.535233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db06a-8d3d-4fb0-b98a-00dc732cfcb9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.574019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.574654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.574930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.575202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.575887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.576187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.577607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.589903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8eef4-8485-4409-bbeb-f8c20572ce06 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.591905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.601616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.658776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.659388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.659664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.659933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.660592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.660889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.662273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.683098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 271/544] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.689172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.696246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:06.792435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:06.795954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e1e90-400a-4b66-bbb4-e718b151dc9c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.835342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.835945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.836219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.836489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.837201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=17858a6841b14bc2bca713bbad4cc5c8) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:06.837498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.839121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c14c5-1faf-4f03-b6f6-6871a4c22d08 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.842823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3f8e-d7a2-4500-9c02-3eaf87cd0b3f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:06.845171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 274/545] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/role_assignments?user.id=17858a6841b14bc2bca713bbad4cc5c8&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:06.846700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f3e1-f24c-40b6-b09c-696bc6d0a439 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.847078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f3e1-f24c-40b6-b09c-696bc6d0a439 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.847445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471f3e1-f24c-40b6-b09c-696bc6d0a439 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.853238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 275/546] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:06.854995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.855385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.855759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.884335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:06.884764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:06.885565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:06.885943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:06.886343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:06.886527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:06.899141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:06.900848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:06.916599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:06.917885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:06.918827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:06.918827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:06.918827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:06.919313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:06.931338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.006643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 276/548] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:07.085827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c59b-a1fe-493f-bc05-a6b01325c9e3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.106491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.135818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.136428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.136705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.136975 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.137613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.137910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.139320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09062e60-6427-4238-a8cc-a0bac528d608 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.157437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.163521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.231909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.269916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56090c-21f3-48e5-9322-cd6ef8b23527 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.270276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56090c-21f3-48e5-9322-cd6ef8b23527 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.270570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56090c-21f3-48e5-9322-cd6ef8b23527 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.272807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 274/550] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:07.277325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.277606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.277980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.303178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f7e4-79aa-4f71-b9e2-fad2244aae54 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.310021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:07.319380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:07.340788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.341343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.341713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.341986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.351387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.353037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:07.365405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.366384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:07.367309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 277/551] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.367885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.411402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 275/552] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:07.412783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.537029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f850646-5c16-443f-9471-4cf8b1a2788e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.542406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.551518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe60681-2c0e-42dc-9013-38e8bb27d258 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.578571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.615339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.615897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.622202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.622202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.622532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.622532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.622532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.622532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.623114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.623114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.624109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.643864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:07.655056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.657189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:07.659404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 278/553] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.665471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.668705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 276/554] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.670707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.784648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ed2-9849-4370-b3c7-a66daa7a44ac None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.813610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7167d5a-edab-44e2-b4df-ef82569bc365 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.820196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.820806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.821085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.821357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.822021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:07.822367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.823796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.837251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 279/555] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:07.837251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:07.869869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.877481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.878354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.878783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.879203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.916946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:07.944325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67be17-9191-48ad-9dcc-118353857479 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:07.956711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:07.958597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:07.979917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:07.980554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:07.980830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:07.981099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:07.991649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:07.996379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:07.997592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:07.998470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 280/556] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:07.999163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.076018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 277/557] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:08.077292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.089089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.104947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b392-f0df-4573-85d4-3b0378da3f2a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.149669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.168281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.168920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.169326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.169624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.180169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.181616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.185363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd653e-025b-47e5-aac0-85728f251a27 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-ee7ffffb-a6c6-44b3-8f92-dd437d565ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.197014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.199146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 281/558] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac82b1-61d2-4f3d-87ac-7c29ae8fcf73 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac82b1-61d2-4f3d-87ac-7c29ae8fcf73 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.200054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac82b1-61d2-4f3d-87ac-7c29ae8fcf73 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.205979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 282/559] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:08.205979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac82b1-61d2-4f3d-87ac-7c29ae8fcf73 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.232859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.233476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.233749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.234037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.234761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.235066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.237075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.249893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 278/560] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.249893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.323621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac82b1-61d2-4f3d-87ac-7c29ae8fcf73 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.359155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.359976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.360250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.360514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.365246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1eb63-781c-45c7-938f-47973c8d361c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.369037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.373151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.379727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e6e3016f-eec8-49b5-a1a7-b1706d9c2d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.390970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.391956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.393396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.393396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.393396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:08.393396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 283/561] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.394231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.394231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.394484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.399874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.407599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.408513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.408623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.408835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.409480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.409772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.411155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.411986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:08.413173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:08.427963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 279/562] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.427963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.490317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 284/563] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:08.490317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.558144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b3e1-0c02-4cc8-bb9a-4e587a7d693c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.601988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.603017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.603203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74e105-2271-40db-a77f-51146f4e0925 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.603772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.604250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.617710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.620249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.626677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:08.640675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.643933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:08.644821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:08.644821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:08.644821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:08.644990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.645954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.646428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.646902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.647237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 280/564] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.647893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.648304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.648574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.650264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.670265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 285/565] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.671844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.710619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.785701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a130b-3973-4dc0-a487-1408779b6f23 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.789728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fbd5-d8e0-4bcb-8d7b-1ce329243c9b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.821093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.821716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.822003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.822338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.827892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.828500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.828773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.829452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.830278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.830396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:08.830604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:08.831728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.831991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:08.842918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:08.849169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 281/566] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:08.850418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.858026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 286/567] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:08.858026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:08.897771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.956442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:08.958390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60edebf-719e-4f75-974e-cbf2ab7f54af None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.959416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5c83-9635-4be5-9498-c7226df1f1b9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:08.994329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.995015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.995289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.995556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:08.996078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:08.996859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:08.997304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:08.997579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.002454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.003912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.008269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:09.012972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.013870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:09.014744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 287/568] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:09.015434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.016219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:09.017106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:09.018104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.021039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 282/569] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.021866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.122558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb479-ed20-44a0-80dd-5b4134c7423d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.123095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.125888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff1a9-8574-4e08-9f1d-9845845cddf9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.156449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.157078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.157358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.157629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.159146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.159738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.160015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.160309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.161024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.161321 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.162780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.169064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.170522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:09.182050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.183111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:09.184847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:09.185387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 288/570] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.185387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.185526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 283/571] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.185526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.208151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.290759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b8bd-bb9c-4201-9952-f80215e41d83 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.291043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cbaea-f567-4b0f-89ad-2b77ee8a64af None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.323728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.323894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.324330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.324448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.324584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.324678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.324849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.324947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.325492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.325607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.325787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.325908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.327173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1cb2-ec8b-4af1-8279-79d72ab0f223 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.327343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.336634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 284/572] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.337771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49c22-d7d7-4a38-ba6e-1ef37cd1e093 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.338051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49c22-d7d7-4a38-ba6e-1ef37cd1e093 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.338355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49c22-d7d7-4a38-ba6e-1ef37cd1e093 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.343999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 285/573] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:09.343999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49c22-d7d7-4a38-ba6e-1ef37cd1e093 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.344217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 289/574] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.344217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.362025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.423118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.441883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c5316-f3ca-4f93-93b4-8e90b8efc288 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.442101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49c22-d7d7-4a38-ba6e-1ef37cd1e093 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.475980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.476145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.476538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.476725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.476829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.477004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.477100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.477280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.478028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.478367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.479801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.487302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.488668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.498594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 290/575] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.500145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-69a507c6-392b-455a-bf27-5065aa6a840c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:09.503947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.505101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:09.506453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:09.506453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.506453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:09.506453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 286/576] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.506453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.506775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.506775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.524758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:09.525962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:09.587558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.605014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 287/577] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:09.607076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.609638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9344b6e-0b7f-4a29-b76c-ee19a3507622 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.648850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.649478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.649756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.650232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.661392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.662745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.671886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:09.678086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.684283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:09.685236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:09.685236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.685236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:09.685236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 291/578] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.685236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.720807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11587-539a-4033-9e84-53e801c0d41b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.757317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.757851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.758128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.758434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.759155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=4375f94a202a43c3abf6b36dd1eb01dc) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.759456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.760878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.766658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 288/579] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/role_assignments?user.id=4375f94a202a43c3abf6b36dd1eb01dc&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.767346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.800659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a695636-3be4-4fa5-853c-5c433f476cf8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.839540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.850733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.851769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.852278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.852714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.871073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.873754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:09.890530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:09.891728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:09.892948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:09.892948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:09.892948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:09.895074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fabad6-721d-4eec-b0bd-f4d1dc7c571b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:09.896471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 292/580] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:09.897338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:09.925117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:09.934702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:09.937148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:09.937148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:09.937148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:09.937148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:09.937148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:09.938090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:09.950104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 289/581] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:09.950951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.013331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8991160-13f3-437d-97f2-2cb923ee2b1c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.048871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.049476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.049752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.050014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.050676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.050988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.052329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.060731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac708-639a-4fb5-abdd-55cebcd985fd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.069570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 293/582] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.069570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.102075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.102737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.103024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.103294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.113653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:10.122819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.123748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 290/583] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.124627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.171566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.177019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.233244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09dc7-f27c-4b9e-a2c0-8ad4ae25722f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.233567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4596d5-12c2-4b5d-be60-7f4f435efd87 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.272479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.273131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.273324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.273591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.277121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.277725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.278003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.278304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.278961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.279256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.280573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.280679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.282005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:10.296278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.297174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.298099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:10.299837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 294/584] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.300966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.302479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 291/585] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.303304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.402203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.405207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2c90c-3871-4fe8-890e-2dfcd6dbbfd0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.410362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582650-76c2-4ba7-8a3c-0d777851b93d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.420792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.440009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.440722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.441061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.441316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.446340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd374399-a05b-4db4-865f-50448242194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.446976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd374399-a05b-4db4-865f-50448242194f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.447243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd374399-a05b-4db4-865f-50448242194f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.447514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd374399-a05b-4db4-865f-50448242194f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.448221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd374399-a05b-4db4-865f-50448242194f None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.448453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd374399-a05b-4db4-865f-50448242194f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.448818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.449850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd374399-a05b-4db4-865f-50448242194f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.450354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.459369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 292/586] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.459918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd374399-a05b-4db4-865f-50448242194f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:10.468391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.469445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:10.470663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:10.474710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 295/587] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.475536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.566779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd374399-a05b-4db4-865f-50448242194f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.576623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd70d-59bb-479b-acf4-5109fecaf59f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.601664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.602316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.602594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.602864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.609909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.610857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.611930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.612033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.612287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.612523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.613207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.613507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.614943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:10.623163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.624066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 293/588] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.624973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.636699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 296/589] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.636699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.658688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.662643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.733914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170c2b1-8dc9-4af6-83f4-9afe11b7aabb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.738378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f11bd-3728-4911-b185-935b6d6518d3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.772705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.773570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.773917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.774173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.774480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.774754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.775057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.775480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.775712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.775826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.777187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.787479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.789226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.794603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 297/590] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.795444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:10.808351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:10.809286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:10.810170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:10.810170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:10.810170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:10.810170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 294/591] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:10.810170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:10.886569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.908874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d1096-d261-4aaa-9ebb-7345bede1ac8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.925203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:10.945845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:10.946488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:10.946756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:10.947023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:10.947692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:10.947986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:10.949566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:10.956719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15830-5652-4abf-9677-f6db9194f465 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:10.962094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 298/592] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:10.967032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.016523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.017167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.017739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.018011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.036754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=2a09e02d84674a8282737d0411be459e, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.039106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.068505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3153f6-42fb-408b-bf0a-3dff70646b5b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.101259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.101873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.102148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.102446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.109287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.113797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.115251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:11.128776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.129690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:11.130592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:11.130592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:11.130592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:11.130592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 299/593] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.130825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.137941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 295/594] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:10 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:11.138792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.269752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5adfc-b33f-4663-9289-45bc40e81dd3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.291750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0e75-a1a8-4292-8d8d-fb1cd7fb4216 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.308356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.315468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.316140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.316416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.322890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/384e6654dbac4182900d6326eb23182b/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.332671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=384e6654dbac4182900d6326eb23182b, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.334101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.334321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.334745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.335027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.335297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.335935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.336232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.337595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.350977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 300/595] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.351659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.399070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 296/596] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:11 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/384e6654dbac4182900d6326eb23182b/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:11.399941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.413355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.482963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fc469-536e-47e6-9d54-304bd63b6032 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.535421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.536425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.536948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.537427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.538341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.538891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.541196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.557399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 301/597] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.567412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.627383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd529cd-dab4-415a-ae72-69d483e3f512 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.668352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.668922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.669200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.669468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.677452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.678696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:11.690959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.691953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:11.692903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 297/598] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.697838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.715297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585d1a-bddf-4fd0-a5d1-071cdb4ce74b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.727763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.746635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:11.754593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.755348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.755732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.756112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.763703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.765271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:11.782453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:11.784745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:11.785850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:11.789155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 302/599] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:11.792524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.809655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6434-b3fa-4f13-9f02-73871d07ac79 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.845073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.846227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.846515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.846787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.847517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.847820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.849251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6914d89-aac9-49da-a893-da0b38720c8e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.867442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 298/600] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:11.868689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f9d9-b4a3-41fb-8b10-1b9648986d7c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.868972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f9d9-b4a3-41fb-8b10-1b9648986d7c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.869251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6f9d9-b4a3-41fb-8b10-1b9648986d7c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.875104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 299/601] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:11.875876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6f9d9-b4a3-41fb-8b10-1b9648986d7c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:11.900427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d0a7-3fbc-43e9-9102-d77d4367bdef None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.936185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:11.936864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.937249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.937630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.938473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:11.938883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:11.940524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16144f-5f52-4862-aba6-0560f0b58a49 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:11.952754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 303/602] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:11.954502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:11.954893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:11.955952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:11.974279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:11.975615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:11.981016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6f9d9-b4a3-41fb-8b10-1b9648986d7c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:11.991228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.006547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.016803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.017954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.018285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.018562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.028871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.030329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:12.049984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.051344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:12.052529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:12.052529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:12.052529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:12.052761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 304/603] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:12.052761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.054933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 300/604] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.059575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.187386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe045f3-c13c-4b66-8b8b-c2590a42ac47 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.228006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.229356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.229356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.229356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.229977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.230306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.232096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.246040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 301/605] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.251524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.267700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.298044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2beb3-9453-4a7b-8502-a6693528b74a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.352455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.353540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.353818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.354245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f21a5d7a9a2043adb471333fd3589f0d/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.363849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0005a5a-2983-42e7-a6c4-6c097010d070 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.375343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=f21a5d7a9a2043adb471333fd3589f0d, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.377534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.401875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.402566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.402846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.403116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.411071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.412517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:12.424414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.425507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:12.426596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 302/606] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.430979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.491879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 305/607] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:12 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f21a5d7a9a2043adb471333fd3589f0d/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:12.492740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.513993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.519208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.551231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b232-de74-4383-be08-f5dd5f6f3db4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.596533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.597400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.597686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.598283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.610816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:12.618013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:12.620398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:12.622289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 303/608] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:12.627876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.724476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471846b7-5e6d-4253-b67b-60768ed51162 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.753435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a58f8-5dc2-43b7-a5a0-a34db93257c8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.780983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.781599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.781872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.782243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.782939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.783304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.784727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.791608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.798265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 306/609] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:12.798511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:12.799648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:12.799991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:12.800291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:12.800954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:12.801254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:12.802653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:12.808053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.813121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 304/610] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:12.822310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:12.915300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:12.979672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d995-e6ef-4b3e-8e24-adc2bd4b458a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:12.991789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423125e-4926-4072-9147-2ac50d18c89c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.046532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.047205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.047483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.047755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/17858a6841b14bc2bca713bbad4cc5c8/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.065756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.066424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.066703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.066978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.082775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.086212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.086402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=17858a6841b14bc2bca713bbad4cc5c8, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.086402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:13.099197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:13.100165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:13.101063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:13.101063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:13.101063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:13.101063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 305/611] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:13.107079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.166149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.184461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 307/612] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:12 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/17858a6841b14bc2bca713bbad4cc5c8/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:27:13.232784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca45f7-dd90-402c-aca1-9a1936fcd0c3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.278067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.278717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.279055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.279329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.279983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:13.280281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.281733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54cbfe-f1ce-4999-9373-450d7c9f5d43 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.302002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 306/613] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:13.307731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.329869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839f6e-8726-49ab-bdc3-1a3f962996c8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.330568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839f6e-8726-49ab-bdc3-1a3f962996c8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.331077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839f6e-8726-49ab-bdc3-1a3f962996c8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.332945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 307/614] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:13.337936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.338485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.338983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.358683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:13.360334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:13.475098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 308/615] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:13.475489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554041-d019-47d7-970b-e0190fb4a0ac None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.506362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.527811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.529005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.529503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.529979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.540627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.542400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-7fd5166a-8685-4bc9-9066-37b979003aa3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:13.555808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:13.556780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:13.557774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:13.560406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 308/616] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:13.571304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.619911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.711139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25c535-e3af-4b86-aa88-e9bdb4ab5501 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:13.763809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:13.764433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.764709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.764979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.765708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:13.766006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:13.766814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314b78-7356-4f88-abce-ab773d59ddec None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.767307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314b78-7356-4f88-abce-ab773d59ddec None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.767552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:13.768581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314b78-7356-4f88-abce-ab773d59ddec None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.770390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 309/617] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:13.776687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:13.776972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:13.777246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:13.793939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 309/618] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:13.796963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.808633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:13.809744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:13.903734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 310/619] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:13.904683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:13.941933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:13.952914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347f90-e0e7-4d92-9d06-31918b9dcad1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.010875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.011515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.011790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.012059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.036418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:14.041245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.042317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:14.043155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 310/620] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.048446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.052608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474b4ef-5ec4-4bbd-b322-1079f55af568 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.090643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.119241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.119870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.120139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.120400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.138674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.140125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:14.171974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.174932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:14.176989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:14.176989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.176989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:14.176989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 311/621] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.181569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.243706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66dcf7-77fc-4471-bcb1-2e22267a237a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.291726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.292599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.292890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.293160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.293822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.294122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.296159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.307478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 311/622] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.308307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.339497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.344554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce6f66-aca6-44f6-bb6d-28748c010cdf None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.383567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.384519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.385006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.385521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.386413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.386936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.388584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.401921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 312/623] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.403202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.429798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.450910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1103600-e2f3-4efe-8f01-bbaccdfb16b9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.498644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.499967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.500859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.501335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.516982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:14.517203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c707bed-b20f-4d8c-b705-7213a16ddd80 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:14.524542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.525506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:14.526365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:14.527895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 312/624] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.528642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.559291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.559924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.560204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.560470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.571526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.573015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:14.589792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.590863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:14.591737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:14.591737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:14.591737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:14.596970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 313/625] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.597767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.638594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.669081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ae1f-66b3-4752-a1fe-f4a40e431ca3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.693699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.717482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.718795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.719026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eba5ff-e138-4bf8-8c43-f6d5646143ae None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.719498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.719977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.730835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.733209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:14.749414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:14.750384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:14.751261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:14.751714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 313/626] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:14.752875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.763796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.765249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.765752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.766264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.767746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.768687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.770623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.782791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 314/627] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.784627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.864799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194825f-131d-4746-b1d7-d846333b0f04 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.907954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.908620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.908901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.909173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.909809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.910111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.910468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f49b2-b3b0-4900-b489-8005d1d02174 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:14.911510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.914559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.926350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 314/628] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.931487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:14.947850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:14.948466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.948745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.949016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.949711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:14.950016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:14.951472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ced-f4bc-4184-9452-dfe1352ea848 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:14.954372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:14.964160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 315/629] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:14.966319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909fee5-7c2f-47a6-8229-d40f5ba64242 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:14.966319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909fee5-7c2f-47a6-8229-d40f5ba64242 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:14.966319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909fee5-7c2f-47a6-8229-d40f5ba64242 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:14.967473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 316/630] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:14.967982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909fee5-7c2f-47a6-8229-d40f5ba64242 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.047485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4614360-4f96-4266-a553-6a3e19c334c0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.077180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909fee5-7c2f-47a6-8229-d40f5ba64242 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.086645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.086645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.086645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.086645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.097285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.098772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:15.114106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.115329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:15.116236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:15.116236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:15.116236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:15.116236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 315/631] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.116236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.121014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.132400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.132400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.132400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.132400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.132400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d389fc9a-5fdc-4608-a1c3-ba7485be11fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:15.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.144417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:15.145348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 317/632] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.145982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.145982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.146955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.164906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:15.166085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:15.174505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.223139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.229423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d864-b725-4d8c-bed5-8012f3330cf5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.240605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 318/633] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:15.241742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.268302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.269117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.269501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.269843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/4375f94a202a43c3abf6b36dd1eb01dc/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.291820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=4375f94a202a43c3abf6b36dd1eb01dc, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.293594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.363038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800de1f-bdd6-41ee-a3b5-924e536900e6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.379045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 316/634] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:15 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/4375f94a202a43c3abf6b36dd1eb01dc/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:15.379502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.439167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.439830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.440107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.440513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.441168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.441464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.442939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5ff2c-8d67-4280-9296-ebc1c2914794 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.456417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 319/635] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.457728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6541-e594-4046-9f66-d0149e0640cf None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.458117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6541-e594-4046-9f66-d0149e0640cf None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.458416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff6541-e594-4046-9f66-d0149e0640cf None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.464035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 320/636] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:15.465065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff6541-e594-4046-9f66-d0149e0640cf None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.519434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.522548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.523309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d246ce-7f36-4609-b989-7a8699726622 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.568647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.569284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.569547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.570737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.570737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:15.570956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.572324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6b4e-66d8-45cd-a882-ad9d849a46b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.582014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff6541-e594-4046-9f66-d0149e0640cf None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.590645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 317/637] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:15.592299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.592794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.593295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.612983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:15.614459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:15.621770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.622496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.622704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.622975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.630817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.632188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:15.644232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.645240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 321/638] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.650972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.694889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 318/639] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:15.695694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.774900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd4aea-1a16-49ba-a4ca-f3db1223050d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.785112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.792011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:15.807465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41e70a-bac9-417b-91c2-dc38b8a45e2e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:15.830280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.831601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.833003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.833964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.847864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:15.848384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:15.848565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:15.848810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:15.849091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:15.855501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:15.856430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:15.857270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:15.866030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 322/640] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:15.866030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:15.927443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:15.928843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:15.977732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6638d54-3b2e-483e-b942-ae298f57c74a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.013860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.014494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.014776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.015056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.015768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.016073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.017557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.018784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.038214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 319/641] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:16.038214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.046578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 323/642] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.048051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.074167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.145425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b015066-f953-474d-9b7d-7e84fe0349c6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.151049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ed290-614e-4102-adea-37580d847e2d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.183302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.184236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.184709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.184977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.185326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.185600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.185869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.186090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.186993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.187635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.189833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.196220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:16.199083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 320/643] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.200139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:16.200819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.201792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 324/644] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.202717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.254011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.298411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.314217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691f8f8-49f2-4277-b9cd-46aeb70a0359 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.318284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50086f0f-694a-4bc1-a1a3-aecc578c996c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.351067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.351697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.351982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.352257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.357442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.358067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.358375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.358644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.364323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.365771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.382909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.384051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.385108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.385108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.385108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:16.385108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 321/645] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.385108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.433575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.435046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.485808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.491985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243b15e-b410-4706-96f2-84ee1c314691 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.526286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.529522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.530155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.530454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.530721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.542111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.543632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.544065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 325/646] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:16.544902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.563060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.564211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.565339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.565339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.565339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:16.566728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 322/647] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.567632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.653481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65bde-92e6-403e-9189-6910a1477044 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.674342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff10098-6854-43ab-8bab-3c268c12e4d7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.688272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.688805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.689076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.689392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.690044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.690437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.691781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.703931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 326/648] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.703931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.714006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.714642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.714923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.715189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.715830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.716129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.717596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.736161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 323/649] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.736161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.748496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.756973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.810707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492140-c312-46e1-a2a0-ce0cf8e51b17 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.837018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effe89-b90f-484a-a2b7-1c6788e5c0c6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.848087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.848721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.849002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.849274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.860582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.862164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.871201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:16.871924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:16.872205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:16.872478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:16.873109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:16.873406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:16.874804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:16.877773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:16.879554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:16.880875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:16.880875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:16.880875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:16.883546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 327/650] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:16.884414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.895225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 324/651] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:16.895225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:16.966097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.988900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:16.992966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945d1a-81c1-4688-8cdf-e1a8d3e7ba23 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:16.997918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c013-7d09-4df1-935b-d92366d91881 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.029056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.029848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.030254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.030623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.033585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.034306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.034590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.034864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.041424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.041723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.043174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.043290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:17.054618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.055666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.056754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:17.059656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 325/652] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.059656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:17.060640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.061815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:17.062981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:17.062981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:17.062981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:17.069030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 328/653] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.069030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.167752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b749e9-54c2-457e-937d-f053e86b767b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.180591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8efd-b4e4-4819-80c3-512f146b4d1c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.201409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.207343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.208048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.208393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.208726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.212148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.212148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.212148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.219625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.220291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.220736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.221112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.227725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 326/654] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.227725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.233713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.235274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:17.248185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.249306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 329/655] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.255710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.264353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.348667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272090dc-e252-46a6-80cb-2e6d801348e8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.358761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf268352-ea73-4d50-b462-1aea2d7488d4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.383133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.383737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.384016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.384289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.384961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.385256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.386702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.392736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.393403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.393681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.393951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.394679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.394980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.396309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.397958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 327/656] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.398765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.408407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 330/657] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.409218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.457550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.479111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.503946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca3bf0-b20b-4fd7-bbb6-b61606c848ac None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.508688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d008e5-19a5-4da9-ac85-a33ff2e0dec1 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.537333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.537955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.538285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.538558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.542589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.543188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.543466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.543738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.544452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.544753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.544941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.546164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.546380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-21a53072-2970-4080-af52-c0d31c4aae3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:17.557105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.558078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:17.558992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 328/658] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.559848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9075-579d-4905-a840-5f273028f804 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.559848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9075-579d-4905-a840-5f273028f804 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.559848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9075-579d-4905-a840-5f273028f804 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.562504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 329/659] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:17.563541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9075-579d-4905-a840-5f273028f804 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.563795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 331/660] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.565199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.662481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c51f-b724-4fd4-8e6f-a7893a0443ae None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.676193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9075-579d-4905-a840-5f273028f804 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.688768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.690617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.696835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.697460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.698902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.698902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.705459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.706924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.711463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.712055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.712327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.712593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.713294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.713597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.715024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b73d3-972e-4869-b262-d2083d751b7c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:17.718423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:17.719459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 332/661] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:17.720405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.722170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 330/662] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.723014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.723295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.723563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.743729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:17.744956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:17.819321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 331/663] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:17.820190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.863515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8336b-0602-40ae-8116-bd156c5869f5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.909888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.910797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.911083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.911352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:17.912282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:17.912586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:17.914891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:17.928861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 333/664] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:17.929816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:17.952592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf6639-d953-4e18-a01f-bd6340db69f8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:17.961793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.996194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:17.998611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:17.999235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:17.999510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:17.999776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.059233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf12a-9102-4ef7-8497-31f4ca6f35c2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.074899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.076630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.102441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.103268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.103918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.104194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.105064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.105371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.106820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.124372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 334/665] 10.222.0.15 () {56 vars in 1139 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.125192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.189111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 332/666] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:18.190391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.199816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.251709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014599-d60f-4b73-9862-8482dbb5edcb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.259976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.291655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.292375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.292728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.293070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.293795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=384e6654dbac4182900d6326eb23182b) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.294103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.295867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.303030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5186bc-fe0a-4ff2-ac63-b9a597be1440 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.310248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 335/667] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/role_assignments?user.id=384e6654dbac4182900d6326eb23182b&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.310248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.347165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.348454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.348917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.349502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.365081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:18.371517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:18.372532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:18.373379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 333/668] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:18.374090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.457483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.460759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cfe3e-2463-48cb-8188-1a3811aed85b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.504228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7e05-4a4c-4e66-9a4c-db69b4751dd3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.505637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.506360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.506711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.507063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.553934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.554915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.555346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.555752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.567365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.568082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.569579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:18.585762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:18.586785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:18.588289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:18.588289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:18.588289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:18.588289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 334/669] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:18.588289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.600163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.601775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.716262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 336/670] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:18.717377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.719430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69e893-a62e-4330-af11-477d03fcfb12 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.739016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.758660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.759582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.760039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.760461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.761292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.761791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.763468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.773875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 335/671] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.775520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.796967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:18.832245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369c73e-bb2e-4813-9e08-30053e9519d2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.868307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.868916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.869191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.869457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.870219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:18.870534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.872018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:18.889808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 337/672] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:18.890798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:18.917458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07e70e-0e8e-4ab7-82a3-1e92e8abd53b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:18.962803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:18.964864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:18.965310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:18.965735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:18.982686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:18.985015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:19.005233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.006439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:19.007646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:19.007646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.007646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:19.008156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e69d4-abb7-43c0-afdb-e2c2f5cdee07 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.009533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 336/673] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.011527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.039549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.046079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.046784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.047171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.047507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.048874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.059461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.061189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:19.078324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.079528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:19.080453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:19.080453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:19.080453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:19.082448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 338/674] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.083427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.120662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11868-3ec9-4f11-b9d5-7a183f4b0566 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.157463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.158874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.159981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.160372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.168083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.170284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:19.185359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.186321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:19.187229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 337/675] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.192262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.198602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743eab0-ecaf-4fec-8f89-813b48c2babb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.247820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.248561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.248908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.249256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.250021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.250420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.252977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.269102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 339/676] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.269991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.308102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.317585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8dc8e-5ea1-4a9e-8a5b-d53323203f67 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.327754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.354378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.355349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.355948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.356495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.357472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.357771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.359221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.372254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 338/677] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.373165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.401161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea563bc-7384-458a-920d-43b372559154 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.444864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.445686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.446490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.446779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.447758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.448070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.450403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.469017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 340/678] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.470265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.495365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dffaa-64c6-4aff-8500-ae50963e8b2e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.540069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.541242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.541525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.541794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.551080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.552511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:19.566919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.567995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:19.568886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:19.569316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 339/679] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.570296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.585924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1f34c-ca56-44ff-85a6-6aad0de306f3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.586713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.589425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.637885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.638882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.639333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.639873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.649070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.651105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:19.666349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:19.667492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:19.668643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:19.671318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 341/680] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:19.672312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.700467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06202be3-8f8b-4a73-9402-f174137d819d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.746903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.747678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.748493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.748890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.750006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f21a5d7a9a2043adb471333fd3589f0d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.750443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.753250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.766295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 340/681] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/role_assignments?user.id=f21a5d7a9a2043adb471333fd3589f0d&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.767257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.850001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b460ac-c49f-4630-a194-d12aff826756 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.895962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.896870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.897291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.897701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.898569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.899607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.901300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af36ef-30bf-490e-ae72-e670a1375c07 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:19.901770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.924345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 342/682] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:19.924345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b830f-39d0-461c-b5ed-cc03aca9b04a None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.924345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b830f-39d0-461c-b5ed-cc03aca9b04a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.924345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b830f-39d0-461c-b5ed-cc03aca9b04a None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.924345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 343/683] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:19.928435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b830f-39d0-461c-b5ed-cc03aca9b04a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:19.938357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49c7fb-835c-48a7-a3e5-4381724bd369 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:19.956477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:19.983189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:19.984659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:19.985407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:19.985952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:19.987436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:19.987882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:19.990049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472e36-68cd-4c10-9c88-d685ae8ece53 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.012135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 341/684] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.013225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.013491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.013765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.033948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:20.035546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:20.057892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b830f-39d0-461c-b5ed-cc03aca9b04a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.106244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.107085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.107765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.108040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.109071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=17858a6841b14bc2bca713bbad4cc5c8) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:20.109370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.110895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71801-8a2e-47c6-b02b-5ec9653beb06 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.112715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 342/685] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:20.113741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.128665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 344/686] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:19 2022] GET /identity/v3/role_assignments?user.id=17858a6841b14bc2bca713bbad4cc5c8&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.199343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.253450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c374-ebee-4ff2-b4d6-1206e93acedd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.313432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.314052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.314422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.314698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.386727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.388114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.410467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1bb3-683f-4249-a523-6ea81d1a3ea5 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.410752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1bb3-683f-4249-a523-6ea81d1a3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.411035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff1bb3-683f-4249-a523-6ea81d1a3ea5 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.412628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 345/687] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:20.419043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.419043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.419268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.440002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:20.441202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:20.470073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.516919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 343/688] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:20.517137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.526320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 346/689] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:20.527027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.546906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.663976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc27314-824f-45e5-a907-e786b0533348 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.697106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ba236-3967-4879-a172-74523ecc0dd6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.725348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.726375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.726893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.727409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.738581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.740290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.743431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.744074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.744350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.744619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:20.757137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:20.758127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:20.759060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:20.759060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:20.759060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:20.761086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 347/690] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:20.766714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.771236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:20.787830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:20.788830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:20.789681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 344/691] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:20.795062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.828375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.878577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:20.903160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c0580-2a45-48b6-8047-9da89f013fef None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.924705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610bff-13d4-4e3a-9e36-bf9976ab5b65 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:20.941442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.942346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.942775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.943193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.944006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:20.944453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.945971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.964077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 348/692] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.964077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:20.968686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:20.969299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:20.969575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:20.969846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:20.970598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:20.970905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:20.972278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:20.985811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 345/693] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:20.987177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.089446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6b02-d8dc-49f9-a157-a51d1f8ad42f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.094286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.112183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5f78-177b-4fcf-8198-e3060c4fadf2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.116674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.125045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.125740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.125991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.126284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.126884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.128292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.154455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.155516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.156079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.156559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.165098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.167134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:21.180751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.181760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:21.182730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:21.189895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 346/694] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.191176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.257342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.258591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:21.259425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:21.260547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 349/695] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.261403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.305966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051beb4-ab6c-46a7-a20b-c5ab3df56ee8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.342339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.343327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.343832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.344311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.356449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.358296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.365143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.366212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b330468-b52b-41f1-9318-9b96767ed97e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:21.374492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.390432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:21.391371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:21.391371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:21.391371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:21.391371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 347/696] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.391371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.401950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.402631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.402903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.403175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.403901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.404553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.405601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.423170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 350/697] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.423170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.479684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.497374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4e8d8-f011-411b-b862-389bdbdb94f1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.530323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0109d-f373-4728-91be-3bb6823708eb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.534794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.535600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.536050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.536623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.537439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.537898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.539598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.544900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 348/698] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.545997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.567597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.568131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.568452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.568766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.569400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.569695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.571114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.584213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 351/699] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.585215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.617727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.659967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2772b6d-5114-4eff-af93-719ee4bbd8ce None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.696195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.697145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.697631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.697739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b76b8c-eafa-43e7-a744-6a17f420c487 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.698587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.699577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=4375f94a202a43c3abf6b36dd1eb01dc) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.700093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.701728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.712263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.714574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 349/700] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/role_assignments?user.id=4375f94a202a43c3abf6b36dd1eb01dc&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.716101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.753106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.753988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.755360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.755783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.756598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:21.758236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.762034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.772926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 352/701] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:21.871765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a34f6-fbe7-4bb7-9939-74a58495d3a7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:21.902122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:21.912012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:21.912653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.912924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.913192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.923122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:21.926569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-578e837c-8d4b-4c6b-8167-4ef7899e18d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:21.943707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:21.944744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:21.945749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 350/702] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:21.951352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:21.953529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82c60-eefc-404b-b940-c7cdcd2115e8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.953883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82c60-eefc-404b-b940-c7cdcd2115e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.954506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b82c60-eefc-404b-b940-c7cdcd2115e8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.962355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 351/703] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:21.969017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:21.969355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:21.969665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:21.997233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:21.998481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:22.078801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 352/704] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:22.081443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915ea0a-ef54-475e-a6eb-823a82f1d588 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.122767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.123373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.124970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.124970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.124970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:22.124970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.126316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.145168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 353/705] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:22.150989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.309909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe8f4-9a65-42cf-a98c-4e6af9a8e041 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.334228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.357035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.357738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.358018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.358317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.434739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.467894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.469907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76211f8d-0a6c-4f1e-9e03-4065923a0211 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.516814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.591196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 353/706] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:22.593695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb85174-9838-40d7-8c08-7558d9e7d93f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.593695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb85174-9838-40d7-8c08-7558d9e7d93f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.593695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb85174-9838-40d7-8c08-7558d9e7d93f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.594671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 354/707] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:22.597374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb85174-9838-40d7-8c08-7558d9e7d93f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.619021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.620518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf025bb-2825-4363-94fb-f60135ca58d0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.659152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.659785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.660057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.660383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.670816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.672257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-baf923f9-8c8a-4d4a-a763-dbe70c3ba02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:22.687609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:22.688569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:22.689835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:22.689835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.689835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:22.693692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 354/708] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:22.694994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.695277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.695549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.714222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:22.715492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb85174-9838-40d7-8c08-7558d9e7d93f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.715610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:22.753172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.753965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.754387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.754773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.765772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.767547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:22.784654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:22.785980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:22.787190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:22.787190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:22.787190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:22.787425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 355/709] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:22.787425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.788611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 355/710] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:22.799960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:22.812186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.891566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb295bd-fbd1-437e-a367-f2ffb5e05fe2 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:22.932594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:22.933208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:22.933484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:22.933754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:22.933966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:22.934438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:22.934938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:22.936086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:22.958796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 356/711] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:22.965105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.008464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb574e-cd3c-4412-9f5e-dc4136fd3f06 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.044971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.045666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.045951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.046249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.047088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.047398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.048937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.070397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 356/712] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.071649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.119980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.143372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e5df4-1a44-4ee0-91a3-6d9700418c99 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.178321 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.178929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.179204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.179472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.180111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.181530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.189192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0ba0-2a96-433e-9a45-4956dc270ce8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.218219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.226277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.227025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.227313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.227587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.228164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.229718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:23.240646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:23.241628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:23.242943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 357/713] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:23.243716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.271240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 357/714] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:27:22 2022] POST /identity/v3/users => generated 254 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:23.272099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.384758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3440bd-2f43-4dda-8cf2-b9d99afa3ed1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.429528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.430110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.430419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.430738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.442893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.444354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:23.458286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:23.459235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:23.460123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 358/715] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:23.471091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.524789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d2f4-11ee-4817-b4bd-e1ac4683e56a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.550569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.556753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.564834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.565515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.565722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.565997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.566673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] RBAC: Adding query filter params (name=network) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.566973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.568409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.573291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 358/716] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.578809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.610752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce092a8d-f51a-4c2d-a482-b075570e38d2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.648029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.649937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.650542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.650863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.651620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.651923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.653391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.677431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 359/717] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:23.683062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:23.715443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebd4a-d262-453c-9173-82776d0f3323 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.770021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.771045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.771796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.772332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.773766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.775054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.776806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72406e82-3a34-443b-bc63-5a85232879b2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.786732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 359/718] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:23.816793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461a68b-8494-4552-94b8-7ae3ed38807c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:23.832457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:23.855978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:23.856699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.856971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.857241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.857972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:23.858313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:23.859846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd83f-14fb-4148-a244-c3f05077325f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:23.867631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 360/719] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:23 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:23.937591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69197-5146-486c-a960-50f907ed67c4 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.937779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69197-5146-486c-a960-50f907ed67c4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.938053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69197-5146-486c-a960-50f907ed67c4 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.939634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 360/720] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:23.946125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10e05-c48c-4886-babc-8f0de95fabcd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:23.946484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10e05-c48c-4886-babc-8f0de95fabcd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:23.946758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10e05-c48c-4886-babc-8f0de95fabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:23.973327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2ef10e05-c48c-4886-babc-8f0de95fabcd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:23.974564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2ef10e05-c48c-4886-babc-8f0de95fabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:24.068929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 361/721] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:24.384031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bbfa-3684-4290-9a43-1ff00d1fd0de None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.384355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bbfa-3684-4290-9a43-1ff00d1fd0de None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.384584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7bbfa-3684-4290-9a43-1ff00d1fd0de None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.386193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 361/722] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:24.393946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.394334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.394539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.421518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7bbfa-3684-4290-9a43-1ff00d1fd0de None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.421739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:24.422759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:24.493180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:24.538320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 362/723] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:24.563907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7bbfa-3684-4290-9a43-1ff00d1fd0de None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:24.613619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:24.614628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:24.615144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:24.615619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:24.616474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:24.618024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:24.702416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 362/724] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:24 2022] POST /identity/v3/services => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:24.899437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:24.941618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.015907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131894-adee-45dd-92cf-f77f7977202a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.074130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.074817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.075075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.075405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.088150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:25.092935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.093835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:25.094685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 363/725] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.101736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.235397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9fc7-433f-4337-8a17-d01701338bdd None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.260273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.290883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.290883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.290883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.290883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.291255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.291255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.291942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.302264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 363/726] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:25.307280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.440129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.448885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ba71-466a-4978-9cf7-e4919b2c05ac None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.485012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.485702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.485922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.486748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.498031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.499528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:25.514278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.515268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:25.516161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:25.516161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:25.516161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:25.516161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 364/727] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.524737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.645133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb6f3-fca1-438f-9a93-0dd3723cac82 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.686008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.686653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.686931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.687204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.687852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:25.688149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.689570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.702364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 364/728] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:25.711468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.823516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521024-a4a1-4a74-923f-e79f0f2a6f3b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:25.858727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:25.859357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:25.859633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:25.859904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:25.867815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:25.869258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:25.880935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:25.881877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:25.882860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 365/729] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:25.887664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:25.934558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:25.992865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016ceb9-8b65-48fe-b07b-d953e74296b3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.028373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.029044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.029323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.029592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.030340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:26.030641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.032057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7999a6-e8b7-417b-b517-609ce7f3a261 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.050758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 365/730] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:26.059300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.063810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.105082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e438-1602-4160-a174-b101a9e73830 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.105584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e438-1602-4160-a174-b101a9e73830 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.105584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5e438-1602-4160-a174-b101a9e73830 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.106978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 366/731] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:26.112128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f47c3-3c97-4bdb-8523-a4af9df807d8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.112409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f47c3-3c97-4bdb-8523-a4af9df807d8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.114383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f47c3-3c97-4bdb-8523-a4af9df807d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.135354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ef0f47c3-3c97-4bdb-8523-a4af9df807d8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:26.136713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ef0f47c3-3c97-4bdb-8523-a4af9df807d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:26.183458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871e8e9-c8fc-4186-91cd-730ffbeedfb2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.220949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.221930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.222041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 367/732] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 12:27:26.222554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.223086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.223441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a859-8ef3-4baa-a6ae-585d07624f53 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.223729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a859-8ef3-4baa-a6ae-585d07624f53 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.224003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a859-8ef3-4baa-a6ae-585d07624f53 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.229629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 368/733] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:26.230966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781835-cbe9-4cfa-ac98-01bcb6cf3b00 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.231251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781835-cbe9-4cfa-ac98-01bcb6cf3b00 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.231528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781835-cbe9-4cfa-ac98-01bcb6cf3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.278065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-77781835-cbe9-4cfa-ac98-01bcb6cf3b00 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:26.279319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-77781835-cbe9-4cfa-ac98-01bcb6cf3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:26.310941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.312228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.314096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.317749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.374282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 369/734] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:26.374282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064743-acba-4f15-a096-6b7e58d5fe89 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.374282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064743-acba-4f15-a096-6b7e58d5fe89 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.374282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9064743-acba-4f15-a096-6b7e58d5fe89 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.374282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 370/735] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:26.377741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.378019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.378315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.423215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:26.427115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:26.443704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 366/736] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 12:27:26.449289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.552515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 371/737] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 12:27:26.585990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.606141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4160-f35b-49db-aee1-e411479008f0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.610569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.649212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.649770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.650048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.650352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.662162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.663944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:26.680015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:26.680957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:26.681861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:26.681861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:26.681861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:26.681861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 367/738] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:26.687758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.734027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.744673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a2848-2242-4fff-9620-e973ff6ef5c8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.782873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.784555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.784996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.785469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.797007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:26.803109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:26.804342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:26.805380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:26.807782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 372/739] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:26.808759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.820971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499994d-26ee-4594-bb06-6d19a660e53e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.870015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.870663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.870980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.871225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.871870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:26.872173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.873542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.885793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 368/740] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:26.886630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:26.904685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:26.928721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105160b-37d9-4b12-9042-b9ac658b2043 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:26.967097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:26.967689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:26.967961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:26.968481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:26.968851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:26.970233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:26.990840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c5127-3021-4594-840b-62ca970ea9a9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.024754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.025351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.025627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.025891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.026585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.026866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.028215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.036250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 369/741] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.037285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.046175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 373/742] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:26 2022] POST /identity/v3/services => generated 240 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:27.047329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.062840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.147486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.172731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903a89-2f72-4b46-831b-5a531c0b8a28 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.202473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952d285-d07c-4fe6-9d2b-939a3e987433 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.215394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.216029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.216309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.216582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.230150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:27.235313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.236286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:27.237135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:27.237778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 370/743] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:27.238301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.250848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.251579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.252619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.252965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.261747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.270204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:27.278964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.280035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:27.281187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 374/744] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:27.281788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.371577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.372999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff26c90-0a75-40ff-81ab-060f752f7c2e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.413996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.414730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.415010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.415285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.416043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e2a8-5a29-462c-809e-90af380ac0e7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.422496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.427465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.428928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:27.443063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.444229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:27.445332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:27.445332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:27.445332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:27.450620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 371/745] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:27.451204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.454021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.454935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.455210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.455498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.456150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.456439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.457796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf81f3-5e10-423a-a1c3-e96b8234c31f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.466502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 375/746] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.472835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121a90-d095-4fb2-99ef-85bbac452043 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.473283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121a90-d095-4fb2-99ef-85bbac452043 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.473561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121a90-d095-4fb2-99ef-85bbac452043 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.479492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 376/747] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:27.480250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121a90-d095-4fb2-99ef-85bbac452043 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.563596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8e70c-1ae6-4597-82f9-56180162d8fc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.590158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121a90-d095-4fb2-99ef-85bbac452043 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.599409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.600014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.600286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.600557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.601239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.601541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.602997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.616841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 372/748] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.617645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.623230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.631573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.635383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f351b-4c6a-47ef-a81c-ededfc2486a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.651318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 377/749] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.651318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.651318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.651318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.667696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:27.668880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:27.676733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.736603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510e31e-5379-465e-ae1a-cf75b6170239 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.750330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 378/750] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:27.751357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.793449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.794283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.794664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.795038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.809169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.811219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:27.832721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:27.833677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:27.834602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:27.834602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:27.834602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:27.834602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 373/751] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:27.835580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.871557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a27e4-d142-4296-8c9d-ed60c6b537a7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.889568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:27.906938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:27.907665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:27.908668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:27.909088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:27.909904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=4375f94a202a43c3abf6b36dd1eb01dc) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:27.910341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:27.912053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:27.926823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 379/752] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/role_assignments?user.id=4375f94a202a43c3abf6b36dd1eb01dc&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:27.927942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:27.958942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30212-04dd-4f71-82f7-782623186828 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:27.961022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.001305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.002761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.003498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.004040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.012878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.014625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:28.027448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.028640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:28.029801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:28.037067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 374/753] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.038721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.123184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4465e0e-2899-40d8-81b1-c05cb43eaa2c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.153189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066bbac-b4c7-45be-a7d1-a6a79295bfa5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.160350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.161212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.161637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.162095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.162945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.163442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.164987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.178827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 380/754] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.180122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.191123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.192183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.192320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.192549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.193347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.193739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.195300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.219057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 375/755] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.219057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.238927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.239772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.309022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567847-8d41-4d2b-9b7c-b6ef88ec69d7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.330361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683b16-70c2-4a4d-a98b-bc75ef7d9646 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.347382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.348315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.348805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.349274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.350126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.351748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.361027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.362306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:28.363253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:28.365485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.366005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.366633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.366748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.366987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.367259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.375241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.376757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:28.389221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.390486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 376/757] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.391921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.475897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.477898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43528b-c390-4740-a49f-46c831543ae2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.485653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.496834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b828f-7a5a-4016-b8a6-43e7aac4bfce None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.515646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.516630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.517053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.517983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.533279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.533876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.534152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.534634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.535445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.535704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.537284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.542111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 377/758] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.542904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.595822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.597694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.645358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ac467-5468-4d7c-9a04-5be339afb97b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.679622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.680226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.680498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.681130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.681475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.681775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.683490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.701034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 378/759] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.701985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.704789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.712458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 382/760] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:28.713509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.726247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.807029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a0b9-7e2b-4cfb-ae78-64acb4b28a2c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.828350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b18a9f-d5fc-4649-af1b-bcf230a1f7af None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.841968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.842607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.842906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.843180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.843767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:28.844060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.845963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.852335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 379/761] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:28.853136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.867578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.868579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.869051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.869466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:28.882148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:28.883820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:28.899958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:28.901121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:28.902058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:28.902058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:28.902058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:28.903607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 383/762] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:28.904618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:28.920097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.956643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b2ddd-70ee-4280-81b7-1310fc9e0d54 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:28.971755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:28.993821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:28.994487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:28.994765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:28.995041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.007133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.008581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.020649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6bc3-12e6-46bd-b765-236e431aac3f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:29.028802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:29.029971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:29.031115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:29.031115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:29.031115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:29.035266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 380/763] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:29.036208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.064895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.065775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.066280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.066801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.068167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] RBAC: Adding query filter params (interface=public, service_id=930cd951e9424951830c32dffd055cbf, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.068644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.070293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.079093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 384/764] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:28 2022] GET /identity/v3/endpoints?service_id=930cd951e9424951830c32dffd055cbf&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.080787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.192111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74634-1f67-42ac-92ca-6d04e4a6cd15 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.195048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4d24f-ef56-4372-8c9a-4b221178eca9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.213152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.216074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.230675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.231323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.231602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.231702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.232113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.232283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.232496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.232603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.232793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.232888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.233427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.233737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.234163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.235128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb65-78fa-433c-83a2-ea740f071bb7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.250565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 385/765] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.252323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.366550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3629-0e43-4b91-8534-c3e71f835ba2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.369500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 381/766] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.370937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0284d-bd98-469c-bf1a-7a088287c892 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.371224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0284d-bd98-469c-bf1a-7a088287c892 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.371493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0284d-bd98-469c-bf1a-7a088287c892 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.377738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 382/767] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:29.377738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0284d-bd98-469c-bf1a-7a088287c892 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.413477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.414111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.414415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.414688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.415286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.416639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.421663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 386/768] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.423217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.494854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.530067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0284d-bd98-469c-bf1a-7a088287c892 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.572646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3e93-bfd8-4f42-bc13-48186d1be2ab None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.576361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.577272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.577769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.578380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.588099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.589725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-89acbac2-a140-40f2-9e91-1381acbc0d5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:29.604735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:29.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:29.606672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 383/769] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:29.607636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.607636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.607824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.621732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.622394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.622725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.623004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.629283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:29.630668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:29.631302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.632915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:29.647450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:29.648408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:29.649329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:29.649756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 387/770] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:29.650338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.673043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.715152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 384/771] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:29.718506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.841900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9beb11-d846-4f27-8435-07c8682ff487 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.865040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe45451-54cb-4d01-9e6c-bda42fcd09d4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:29.880019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.888821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.889700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.890145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.891097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.891564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.892052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.894260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dbee6-9d8f-4dcf-8a41-da0941e7e765 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.907291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 385/772] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.913010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d87-74d8-4508-8168-ba520e2bcb33 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.913135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:29.913135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.913135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.913342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.913911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:29.914228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d87-74d8-4508-8168-ba520e2bcb33 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.914331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:29.914843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c7d87-74d8-4508-8168-ba520e2bcb33 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.915674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec3385-e3e1-4907-8289-e9699e0080fb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:29.916860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 386/773] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:29.918542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7d87-74d8-4508-8168-ba520e2bcb33 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:29.928947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 388/774] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:29.934820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:29.935101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:29.935381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:29.950584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:29.953424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:29.955371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:30.027887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 389/775] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:30.028806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.029675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c7d87-74d8-4508-8168-ba520e2bcb33 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.066989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.067750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.068085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.068426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.070537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=2a09e02d84674a8282737d0411be459e, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.072030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.136069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.141880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b486d8f-6241-49cf-a085-2d2b95e1a33d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.176594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.177196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.177529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.177749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.178564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=94795892e1d54081a2e10d2f55bb6a08) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.178858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.180355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.180929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 387/776] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:29 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:27:30.182349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.186898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 390/777] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/role_assignments?user.id=94795892e1d54081a2e10d2f55bb6a08&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.290406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.303478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adae17-4fa7-4fbb-8f13-45545d194ba2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.310582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.348143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.348800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.349081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.349509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.350113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.351656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.363668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.364726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:30.365551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:30.366538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 388/778] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:30.373258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.489409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f296c-5e76-4675-a6a9-d77107585a22 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.508430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f54c14-42c6-437c-85a6-d79d104c08d9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.525877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.526841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.527311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.527693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.538913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:30.544963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.546214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:30.547263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:30.549048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 391/779] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:30.554610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.557625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.559444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.559881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.560302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.561077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] RBAC: Adding query filter params (name=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.561543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.563176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.571026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 389/780] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.582207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.593391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.603968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.724411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62eb0e-23dc-4c96-98b9-4217b029a6a7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.760709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.761660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.762118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.762595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.763483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.763965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.765496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.774419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 392/781] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.779543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.784524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf375f8-9e37-4bb9-a93e-4b156c012f50 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.870574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:30.889540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da12a-0714-48c6-b2b6-cbb4d4694099 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:30.919463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.920084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.920362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.920638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.921258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:30.921555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.922932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.928289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:30.929094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:30.929528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:30.929950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:30.940566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 390/782] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:30.941581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:30.943210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:30.946502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:30.969885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:30.971467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:30.972630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:30.972630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:30.972630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:30.976084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 393/783] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:30.979439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.110881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.131879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f6a8c-ee18-4ef3-8654-982fcbcfc0f9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.168016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.168625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.168903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.169177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.169872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] RBAC: Adding query filter params (interface=public, service_id=4c5a21a07c2b4f0e84b33737c766726f, region_id=RegionOne) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.170197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.171694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.179881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 391/784] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/endpoints?service_id=4c5a21a07c2b4f0e84b33737c766726f&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:31.185239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.214302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d690c-8561-47d4-b0f5-bdbcd2b37f7e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.310934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.311599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.311830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.312085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.312730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.313027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.314953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.316614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.326743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b0e0-711e-4186-82ac-91a91caebd5c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.340559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 394/785] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.346929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.364463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.365001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.365281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.365555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.366165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.367566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.373380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 392/786] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.476085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f30614-7d5e-4ea6-94cf-0a2a9350311f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.523724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.524386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.524661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.524932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.533436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.534927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-ebbb4c4c-811c-450a-bc87-20d90f7a194d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:31.554153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:31.555173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:31.557444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 395/787] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:31.561407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.589817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.682735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1781-a12f-4f0f-981d-3e39e0982097 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.720001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.720711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.721026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.721026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.722074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:31.722978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.723696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479f01-3559-4144-8fa4-df820f245b11 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.723973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479f01-3559-4144-8fa4-df820f245b11 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.724246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de479f01-3559-4144-8fa4-df820f245b11 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.724397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.725732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 396/788] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:31.731339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.731887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.732362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.744748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 393/789] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:31.749989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:31.754258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:31.759620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:31.816732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.823765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:31.842287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 397/790] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:31.863226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180aa5-f1f7-447f-b05c-a93f920efedb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:31.899680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:31.900312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:31.900593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:31.900864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:31.912036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:31.913590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:31.928727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:31.929683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:31.931214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:31.931214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:31.931214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:31.931214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 394/791] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:31.935620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.075415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeda9f-849c-49d5-9b13-bb62aa15202b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.113450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.114839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.115473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.115944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.116793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.117293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.118908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.131988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 398/792] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.137103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.271083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.294332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027b33-42bf-4120-9884-64eef24f94f5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.330676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.366536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.368220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.369055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.369338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.369612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.383766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.385230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:32.409380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.410517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:32.411503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:32.414866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 395/793] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:32.418662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.444090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5fa-70bf-4551-832f-a79fb7992698 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.488812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.489545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.489831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.490666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.491253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.493180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f307083c-1936-475f-8d9e-7455f6aee56d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:32.505443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:32.506861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:32.508138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 399/794] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:32.509648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719325c2-4da8-4ae5-865b-17efe9f483ad None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.509648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719325c2-4da8-4ae5-865b-17efe9f483ad None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.509648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719325c2-4da8-4ae5-865b-17efe9f483ad None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.515444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 400/795] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:32.516195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719325c2-4da8-4ae5-865b-17efe9f483ad None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.560814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aff096-ec05-4751-99d0-7de2b0749c8c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.603664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.604276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.604546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.605172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.605928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.606265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.608291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a420c-13ad-4f9a-bd79-3380221dafc2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.626023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 396/796] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.629389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f28d-f052-4ec4-92f7-829babc21b39 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.630192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f28d-f052-4ec4-92f7-829babc21b39 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.631225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f28d-f052-4ec4-92f7-829babc21b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.638142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719325c2-4da8-4ae5-865b-17efe9f483ad None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.649569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.655701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3be4f28d-f052-4ec4-92f7-829babc21b39 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:32.657440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3be4f28d-f052-4ec4-92f7-829babc21b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:32.677012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.677622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.677903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.678192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.678878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.679214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.680705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.687650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 401/797] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.688425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.694900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 397/798] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68db15-08f7-4652-89f1-445c24ad27d7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68db15-08f7-4652-89f1-445c24ad27d7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68db15-08f7-4652-89f1-445c24ad27d7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 398/799] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:32.750342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68db15-08f7-4652-89f1-445c24ad27d7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.806523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd60ec-b501-4862-9ebd-d659792bc04d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.845076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.845681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.845965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.846269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/4375f94a202a43c3abf6b36dd1eb01dc/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.848395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=4375f94a202a43c3abf6b36dd1eb01dc, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.849826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.864471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68db15-08f7-4652-89f1-445c24ad27d7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:32.902360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:32.902968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.903248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.903524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.904202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:32.904553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:32.905921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20121-cebd-419e-93af-f9680950779f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:32.914366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 399/800] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Aug 22 12:27:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:32.915684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:32.916540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:32.916540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:32.920638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 402/801] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:32 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/4375f94a202a43c3abf6b36dd1eb01dc/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:32.921442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:32.955814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:32.957041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:32.994585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.021810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.085478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae54b-a537-4887-94e3-867e8fe2acf7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.088739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 400/802] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:33.089952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.138693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.139228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.139506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.139778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.140499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.142916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.218887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499f357-ee41-4d50-a050-23d99430d560 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.251265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 403/803] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:33.263195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.264265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.264776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.265247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.277536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:33.282826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.284288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:33.285118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:33.292682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 401/804] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.294059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.382109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.420039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.440960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.471499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee44-d24f-497a-81db-28f6cb16af17 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.526787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.527693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.527975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.528248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.529174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.529477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.531677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.546278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 404/805] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.548990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.558965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f387-8cdb-497d-8de3-e63f607445f7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.612543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.613159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.613438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.613706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.629682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:33.634484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.635430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:33.636269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 402/806] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.642165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.693282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27588c6-2300-4081-848d-e6e1dbaf55ae None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.732920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.733925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.734455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.734959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.748063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.749964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-33305964-c16e-4bb9-af66-8aac9430e248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:33.774009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:33.775093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:33.776000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:33.776000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:33.776000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:33.778269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 405/807] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:33.779070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.781036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a23d3-f77d-488f-bb13-4b739341bce6 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.781569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a23d3-f77d-488f-bb13-4b739341bce6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.782054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a23d3-f77d-488f-bb13-4b739341bce6 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.783855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 406/808] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:33.784839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a23d3-f77d-488f-bb13-4b739341bce6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.787891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:33.802812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ab5e-3d27-4352-8b7c-9e63eb7a6544 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.840242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.840852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.841126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.841393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.842050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.842433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.843788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a898b-6064-4738-b855-eb85b94e53c2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.853594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 403/809] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.859327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.859619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.859890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.880555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:33.881747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:33.904224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a23d3-f77d-488f-bb13-4b739341bce6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:33.943774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:33.944803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:33.945304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:33.945788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:33.946751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:33.947289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:33.948931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:33.955747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 404/810] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:33.957062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:33.962468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 407/811] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:33.975386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.030993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.065676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce01a8-08dc-4913-b73f-c5cf4f3070ea None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.099630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.105505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.106442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.106939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.107438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.118882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.127371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:34.136854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.137816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:34.138829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:34.138829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.138829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:34.140923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 405/812] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.147543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.201144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947c292-0053-41ba-ab58-02f5c8cf51ea None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.255838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf2435-e4ef-4b8a-983a-169482e494f0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.276970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.277626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.277906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.278204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.289621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.295851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.297378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.299300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.300925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.301409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.301846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.304344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.304344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.304943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:34.310464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.311401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:34.312323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 408/813] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.312900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.322996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 406/814] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:34.328364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.425992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01389d-4daa-43fb-85cd-a09c0760d67b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.435860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e967f-9b52-4d8e-9a02-52e55f2473c5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.458301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.471197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.472105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.472586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.473056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] PATH_INFO: `/v3/services/network` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.473952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.475727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.477075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.477690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.477970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.478308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.479018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.479321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.480808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.486906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.487974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 12:27:34.488802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:34.491513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 409/815] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.492573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.500354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 407/816] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.501029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.548151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.597852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08c085-6f02-439b-956a-9d16f6ef195a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.614730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92495c0b-913f-416b-a7df-83b5fd197713 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.634438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.635408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.635887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.636357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.644162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.645876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.653594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.654285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.654568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.654840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.655469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] RBAC: Adding query filter params (name=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.655769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.657138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:34.660199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.661105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:27:34.662057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:34.662617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 408/817] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.663167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.669094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 410/818] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.670231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.719230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.776277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791011-015f-4ca8-a8ec-4e336a44f7c8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.777060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab276643-06a0-43cf-b96a-6a6fb346798e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.779701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.812888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.813650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.814034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.814965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.815894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] RBAC: Adding query filter params (type=network) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.816295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.817915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.818698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.819588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.820047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.820510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.823743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 411/819] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.824608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.832779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.834573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:34.851582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:34.852876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:34.853811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:34.853811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:34.853811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:34.855573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 409/820] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:34.856499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:34.928799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298785b-c01c-49df-8851-49709ac59fcd None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.939814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:34.964494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:34.965192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:34.965539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:34.965884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:34.966751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:34.967123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:34.968698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:34.972046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a152cd9-4ec8-4b5b-b436-e2e2c77a2329 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:34.986527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 412/821] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:34.991895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.010228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.011196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.011702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.012155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.013048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.014769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.083132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 410/822] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:35.084385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.097595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961eebb-68db-4aba-9e35-44e95dd6927c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.104411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.143471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.144091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.144368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.145385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.145812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.146247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.148544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577880d-983f-445f-b1a1-09f65f268055 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.165622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 413/823] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.166975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64b1b-bf20-4b89-81c5-5beeeff34bbb None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.167262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64b1b-bf20-4b89-81c5-5beeeff34bbb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.167536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc64b1b-bf20-4b89-81c5-5beeeff34bbb None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.169354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 414/824] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:35.170837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64b1b-bf20-4b89-81c5-5beeeff34bbb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.199319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.227894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617773a-ae10-4836-ac75-1100d601e6dc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.276473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.277092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.277371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.277640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.291221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc64b1b-bf20-4b89-81c5-5beeeff34bbb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.342915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.344188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.344540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.344884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.353175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.354674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.361633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.363122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f731a0b4-82df-4c16-99bb-8eb0c940bf62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:35.366514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:35.367398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:35.368290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 415/825] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:35.369238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.369336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.369599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.381525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.393892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:35.395122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:35.464514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 416/826] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:35.465366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.469643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 411/827] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:35.476125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.490012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.581219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f88946-d850-42b6-9a90-a7ce22786b5e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.611468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9696b0-d0a7-4704-9ffe-c64ce4bff517 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.617211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.617807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.618083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.618394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.619085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.619381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.620792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bee24-d6d8-4f53-b9b2-e3cee044e57f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.630428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.634065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 417/828] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.635489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941862-edab-435e-8e57-ffa390e78d53 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.635778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941862-edab-435e-8e57-ffa390e78d53 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.636054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941862-edab-435e-8e57-ffa390e78d53 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.637390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 418/829] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:35.640673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941862-edab-435e-8e57-ffa390e78d53 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.656328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.657137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.657467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.658513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.669717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.671301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8002fac3-5c9b-4568-bfb7-8829e90e49b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:35.687072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:35.688047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:35.688963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:35.688963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:35.688963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:35.688963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 412/830] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:35.689660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.689660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.689913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.708209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:35.709384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:35.724029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.748378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941862-edab-435e-8e57-ffa390e78d53 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.778094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 413/831] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:35.778950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.784516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.785466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.785861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.786228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/94795892e1d54081a2e10d2f55bb6a08/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.806700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=94795892e1d54081a2e10d2f55bb6a08, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.808547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.872367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:35.878993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5d545-cdaf-4c65-a296-44452923d950 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:35.889594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 419/832] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:35 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/94795892e1d54081a2e10d2f55bb6a08/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:27:35.890649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:35.927218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:35.928324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:35.928913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:35.929366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:35.930487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:35.930887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:35.932352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:35.946731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 414/833] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:35.952192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.018791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b647-3ecb-44a8-ac06-81614f5fdfd5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.050194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.062289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.062926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.063197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.063698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.074826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:36.075401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf4f89-49aa-4f0c-a816-806174747613 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:36.080707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.083861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:27:36.084698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:36.086484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 420/834] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.087189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.116653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.117652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.118109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.118410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.125345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.128485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:36.138353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.139405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 415/835] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.140588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.157273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.195636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7619536-05c8-45da-8c7c-6146dc0a207b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.232060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.233069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.233487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.233936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.234539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.236123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.241804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28493b-489b-496f-8b5b-4e89dd23f83c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.245071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.246046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:36.247312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 421/836] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.252157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.280979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.281512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.281787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.282058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.285450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.285450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.285450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.295683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 416/837] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.295683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.310774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.366218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e367-9f58-44ff-974f-f52240105a3f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.384545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.401931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.402719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.403292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.403567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.404517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.404815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.406515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.409797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75104c4-fadf-474e-ad69-c9101a91d95d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.424047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 422/838] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.424942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.447087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.448023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.448023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.448318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.448914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.449213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.450600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.459926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 417/839] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.459926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.536116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa0cc-8bd7-4188-bb70-91b351f6ff6f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.546081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.568262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05fed-cd5e-4bff-86c3-301e9298741d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.570673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.572258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.572636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.573001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.587246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.589440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.605285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:36.605571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:36.606719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:36.607848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:36.607848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:36.607848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:36.608054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.608054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.608054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.608054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.608054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.608818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.609419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 423/840] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:36.622523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.622719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 418/841] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.622719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.627616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.728091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40233ba-fba5-4e08-b0c7-2f018bea849e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.756118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab895e-c583-44e6-8a2d-b46112adaf1c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.765489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.765807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.766241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.766589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.767826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.768197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.769730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.782486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 424/842] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.800376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.801326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.801794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.802311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.803147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:36.803643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.805232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:36.820048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 419/843] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:36.828244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:36.859262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:36.941624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41442e53-5cba-4be5-9f53-1f5f7f8d1792 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:36.977739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:36.978549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:36.978831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:36.979135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:36.987388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:36.988854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:37.002637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:37.003653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:37.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 425/844] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:27:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:37.009457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.077491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.116627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dc6f7-593e-441f-88d6-621060e585f1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.151954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.152581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.152863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.153138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.153868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.154174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.155621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.174941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 420/845] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.180241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.274959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.298559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0378975-2f64-4904-81d7-2a6981bac61e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.334155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.335107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.335604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.336070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.405129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.406934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.498555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.508028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 426/846] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:37.513355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.622308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac50f-3bf3-4a00-8121-508b018e61b7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.646554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.658383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.659014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.664101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.664101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.669575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.671113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-448a392e-b125-477e-adcd-1e5ae0ba07eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:37.686593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:37.687796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:37.688873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:37.688873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:37.688873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:37.688873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 421/847] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:37.695332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.798076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563440c6-3fad-402d-b0e4-c1001cd51261 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:37.844009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:37.844619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.844898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.845172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.845853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:37.846156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:37.847624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:37.859792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 427/848] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:37.864000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051929df-9ea2-4449-a4cc-8821cc7c091a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.864285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051929df-9ea2-4449-a4cc-8821cc7c091a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.864561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051929df-9ea2-4449-a4cc-8821cc7c091a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.865994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 422/849] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:37.867220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:37.870712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:37.871047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:37.871324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:37.890084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:37.891126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:37.919730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:37.970285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 423/850] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:37.985630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073161-13dc-4162-8132-ab8247e5a396 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.020338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.021249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.021729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.022219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.029357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.031107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:38.043210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.044073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:38.044958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:38.047342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 428/851] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:38.053363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.160320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d432a-672e-4f84-bf9c-fc38070792db None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.162638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.195326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.195925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.196200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.196469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.197146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.197442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.198893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.212075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 424/852] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.217984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.255017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.323560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182b104-262a-4fcb-b4d0-5f92b1550743 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.326502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.360010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.360332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaefd0-3398-4237-aaed-67197458473e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.360900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.361308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.361681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.362547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=4375f94a202a43c3abf6b36dd1eb01dc) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.362955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.364491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.374319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 429/853] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/role_assignments?user.id=4375f94a202a43c3abf6b36dd1eb01dc&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.398506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.399158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.399435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.399705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.412832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:38.418522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.419673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:38.420854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 425/854] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:38.426118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.547358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f671-2d59-4b18-a772-4a3046eb4aeb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.583846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.584463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.584742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.585012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.585671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.585972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.587372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58789a9d-4aea-4fc2-b804-c2720efd496d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.596561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 430/855] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:38.602300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.632005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.695241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dedf-f103-4fe7-b7cd-b87ad3bc20cc None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.695545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dedf-f103-4fe7-b7cd-b87ad3bc20cc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.696122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dedf-f103-4fe7-b7cd-b87ad3bc20cc None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.697261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 431/856] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:38.702819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8c8e-66bd-4e56-a481-6928d58e4fbf None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.703261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8c8e-66bd-4e56-a481-6928d58e4fbf None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.703636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8c8e-66bd-4e56-a481-6928d58e4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.711764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956de24b-bf53-45bc-855f-584032da8eba None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.723967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b5db8c8e-66bd-4e56-a481-6928d58e4fbf None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:38.725264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b5db8c8e-66bd-4e56-a481-6928d58e4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:38.749291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.749923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.750245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.750539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.753351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.763175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.764814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:38.779317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:38.780343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:38.781696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:38.781696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:38.781696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:38.781696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 426/857] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:38.787480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:38.815352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 432/858] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:38.832190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9e2-148f-41d3-9512-74141c9ac59c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.832470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9e2-148f-41d3-9512-74141c9ac59c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.832789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9e2-148f-41d3-9512-74141c9ac59c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.834527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 433/859] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:38.839928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.840467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.840941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.859889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:38.862591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:38.886906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:38.910749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3977af6-0a63-4892-8a54-63ce98469a86 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:38.946880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:38.947885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:38.948358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:38.948838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:38.949667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:38.950161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:38.958202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 434/860] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:38.958345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:38.968993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 427/861] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:38.974643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.068588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.078817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b33f6-9976-45d6-b0a2-1db32bc280a6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.097736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.126538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.127241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.127521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.127798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.137508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.139841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:39.155089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:39.156078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:39.157751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 435/862] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:39.162378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.218550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2dffc8-2a85-4ea8-b6aa-6f6242d8646b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.259397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.260406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.260890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.261418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.262303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.263755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.266417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:39.274813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:39.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:39.276732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 428/863] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:39.277516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.289272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bff13-5cad-4ace-95b7-ca0d10c7dddc None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.324523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.325124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.325404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.325678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.326433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.326797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.328225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.350438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 436/864] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:39.351273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.363201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.386470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff4846-7b6f-41eb-8fe2-522c2f40108a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.423361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.424371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.424852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.425339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.426200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.427940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.450678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c216b-cc78-424b-83c3-80d84b62f848 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.484857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.485391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.485695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.485979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.487164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.487612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.488976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.493369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 437/865] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:39.494127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.514282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 429/866] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:39 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:39.519682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.576081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.619074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39da1a-f5b5-49d6-aec3-bc63df0a037d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.621189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.668712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.669393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.669677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.669946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.683422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32078f-edf2-4a00-befd-4e5c953cdc2f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:39.730508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:39.731406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:39.731887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:39.732165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:39.734117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:39.734117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.737210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.742503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 430/867] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:39.754942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:39.756518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:39.846859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:39.870538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 438/868] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:39.879334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:39.990414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeba6f-3544-4621-90f5-98149f615033 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.015338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.028014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.028648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.028924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.036952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.040732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.042201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:40.056696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:40.057672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:40.058602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:40.058602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:40.058602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:40.058602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 431/869] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:40.063559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.168384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfc7c0-d324-4182-b350-6fdc8da9b0af None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.203542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.204156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.204432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.205196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.205665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:40.205965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.207373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.219892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 439/870] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:40.225744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.333650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2f84c-e6d7-448a-8c68-f82713c6bd19 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.368448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.369364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.369817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.370097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.377199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.378661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2250773d-9db8-4cc0-a797-fdacd5f3a1e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:40.389841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:40.390721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:40.391608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 432/871] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:40.397611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.430645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.464282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219e74-2ff4-45a1-a80c-cfc2a74539ab None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.464570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219e74-2ff4-45a1-a80c-cfc2a74539ab None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.465278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219e74-2ff4-45a1-a80c-cfc2a74539ab None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.466677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 433/872] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:40.471907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.472188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.472458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.492371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:40.493692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:40.509080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590aab61-ced0-4801-839a-6a4644a6dbd5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.524098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.559447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.559983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.560258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.560532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.561274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:40.561611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.563068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.577782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 440/873] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:40.586396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 434/874] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:40.587244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:40.676427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:40.688738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b7ec-8c15-4a4a-8aba-3923e99e3031 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:40.725667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:40.726316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:40.726596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:40.726867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:40.727703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=94795892e1d54081a2e10d2f55bb6a08) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:40.728012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:40.729523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:40.739252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 441/875] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/role_assignments?user.id=94795892e1d54081a2e10d2f55bb6a08&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:40.894052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.000686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e234421-a1d6-4f08-abce-812de8d98333 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.037137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.038172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.038679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.039182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.039960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.041554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:41.050670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:41.051681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:41.052506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:41.055254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 435/876] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:41.061658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.174968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907784e-2776-4c65-906d-756236a76f8b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.210159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.210791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.211070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.211344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.211968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:41.212267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.213622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7d930-2c91-4153-b7e3-822df26f275f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.218728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 442/877] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:41.224412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.258431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.340439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7f402-bbe6-43e7-89ac-34b391b7dcdb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:41.378461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:41.379071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.379352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.379627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.380255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:41.380555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:41.381932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70567c-e4dd-410f-93ec-4c8375123e43 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:41.387084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 436/878] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:41.573068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c81e37-4869-4c00-87c8-0a2456871a70 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.573480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c81e37-4869-4c00-87c8-0a2456871a70 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.573609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c81e37-4869-4c00-87c8-0a2456871a70 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.575215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 443/879] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:41.580640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52e1d-4143-4c3b-b6c8-cd61e750ec66 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.580923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52e1d-4143-4c3b-b6c8-cd61e750ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.581195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d52e1d-4143-4c3b-b6c8-cd61e750ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.600879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-02d52e1d-4143-4c3b-b6c8-cd61e750ec66 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:41.602055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-02d52e1d-4143-4c3b-b6c8-cd61e750ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:41.671465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 437/880] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:41.765835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787bae-430f-4e24-98f4-85edb2b59add None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.766222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787bae-430f-4e24-98f4-85edb2b59add None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.766416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787bae-430f-4e24-98f4-85edb2b59add None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.768086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 444/881] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:41.773379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:41.773666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:41.773934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:41.792615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:41.793786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:41.812022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:41.865753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 438/882] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:41.947069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787bae-430f-4e24-98f4-85edb2b59add None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:41.967238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.057822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787bae-430f-4e24-98f4-85edb2b59add None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.092955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.093655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.093853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.094126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.094734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.096134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:42.104966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:42.105947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:42.107448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 445/883] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:42.115987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.144892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.239709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb754d-a69c-4dd9-9796-1d164e5dd7c6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.252881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.268475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca9cf-6298-49cc-ac12-2895e5b92df9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.281841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.282514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.282789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.283588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.284426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.284554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.285856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.295634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 439/884] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:42.296709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.315678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.316388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.316741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.317086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.317793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.319302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.324344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.412423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3eb00-102f-4b56-93b5-f510f7fa4a0b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.430385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 446/885] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:42 2022] POST /identity/v3/services => generated 269 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:42.459376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.460380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.460935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.461393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.462418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.462966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.465258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.473419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 440/886] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:42.479933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.598388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100cfc5-91a3-4ab3-9150-6d3f47984000 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.634425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.635031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.635305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.635575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.636259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] RBAC: Adding query filter params (interface=public, service_id=b2292901d07a4b5babd8cd75d4cace15, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:42.636561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.637918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58daf7a-27a6-4df4-a810-210b28925b4b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.643748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 447/887] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/endpoints?service_id=b2292901d07a4b5babd8cd75d4cace15&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:42.649298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:42.731659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:42.755274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca1411-0ffc-456e-aa9f-21409d1b28d0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:42.791238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:42.791849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.792126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.792394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.793056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:42.794442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c524234-0ee1-4620-a1ed-da5494681672 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:42.806365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 441/888] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:42 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:42.912571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d06ce-dc7c-40a7-8f52-ba6bb2b545f0 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.912959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d06ce-dc7c-40a7-8f52-ba6bb2b545f0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.913136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d06ce-dc7c-40a7-8f52-ba6bb2b545f0 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.914794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 448/889] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:42.920420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424c7f-a2f6-4f5b-80b5-b815e74b6fd4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:42.920735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424c7f-a2f6-4f5b-80b5-b815e74b6fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:42.920967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424c7f-a2f6-4f5b-80b5-b815e74b6fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:42.940311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e4424c7f-a2f6-4f5b-80b5-b815e74b6fd4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:42.941504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e4424c7f-a2f6-4f5b-80b5-b815e74b6fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:43.015433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 442/890] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:43.307532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d06ce-dc7c-40a7-8f52-ba6bb2b545f0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.311458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.331889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b34b6-a83b-4a47-8678-54e3e1b8cd4d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.332425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b34b6-a83b-4a47-8678-54e3e1b8cd4d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.332425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b34b6-a83b-4a47-8678-54e3e1b8cd4d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.334012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 443/891] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:43.339064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.339347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.344780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.358271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:43.359760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:43.430879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d06ce-dc7c-40a7-8f52-ba6bb2b545f0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.446701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 444/892] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:43.475370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.476002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.476279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.476606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.487808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:43.492619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:43.493617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:43.494539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 449/893] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:43.501656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.504539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.607091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dd8a7-4965-4aaf-9a9c-343006f4467d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.645343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.645947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.646245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.646515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.647168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:43.647463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.648819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.657244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 445/894] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:43.663247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.723896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.738796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.792426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b6f5-cc63-4aa7-ab38-437bbc253c7b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.794601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:43.830950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.831824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.832277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.832709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.837025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9cc8-1a03-4e04-895f-a7f1552d3ede None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:43.844528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.847199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:43.863762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:43.864732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:43.865628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:43.865628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:43.865628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:43.867893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 450/895] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:43.876248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:43.881369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:43.882401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:43.882739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:43.883010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:43.883762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:43.885125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:43.956591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 446/896] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:43 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:44.008340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a2390-dd20-4d2f-87ae-0a5e3538c850 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.031570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.058475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.059364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.059703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.060083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.060794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.061102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.062526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.077996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 451/897] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:44.084094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.197114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5daf0-456f-468c-a5b7-e7718ec1331f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.222281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.233541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.234508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.241862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.241862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.243700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.245137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:44.256560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:44.257545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:44.258531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 447/898] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:44.269666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.374375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7a93-6ec6-4c10-9d9a-f42061480c9b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.410204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.410813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.411086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.411355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.412068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:44.412365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.413771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f73c86-653d-47ff-b1d2-00ed9c50c415 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.432079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 452/899] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:44.437876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.559944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9748b0-d975-45ef-a498-32ff6b0ea566 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.603944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.605030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.605505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.605978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.625480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b464b-9d7f-4cd8-b956-b43cfee7760a None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.625821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b464b-9d7f-4cd8-b956-b43cfee7760a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.626040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b464b-9d7f-4cd8-b956-b43cfee7760a None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.628203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 453/900] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:44.633522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062b53-5450-47ad-ac37-8008d76bc99f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.633803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062b53-5450-47ad-ac37-8008d76bc99f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.634083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5062b53-5450-47ad-ac37-8008d76bc99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.652905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d5062b53-5450-47ad-ac37-8008d76bc99f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:44.654103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d5062b53-5450-47ad-ac37-8008d76bc99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:44.665641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.678947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.681639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.683134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.731454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 454/901] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:44.784680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4776-04a1-48fd-8612-565df683e2e3 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.785296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4776-04a1-48fd-8612-565df683e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.785790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4776-04a1-48fd-8612-565df683e2e3 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.787638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 455/902] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:44.789152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 448/903] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:27:44.795055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.795539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.796029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.796500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.815449 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:44.816937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:44.881230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:44.889096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 456/904] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:44.906172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52601-28ca-48f8-bd51-ed425c4c027b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:44.950019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:44.950688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:44.950966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:44.951234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:44.962329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:44.963878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:44.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:44.979675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:44.980605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:44.980605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:44.980605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:44.980605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 449/905] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:44.987470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:44.997762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.092408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.105917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcf41e-6654-436b-9ad3-afbfd33b08d9 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.119258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68913889-87e2-48c7-87d0-3a043543788b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.156726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.157463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.157965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.158428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.158637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.159016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.159158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.159488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.160070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.160370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.160774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.161989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.162354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:45.171470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:45.172509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:45.173406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:45.176809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 450/907] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:45.178373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.181141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 457/907] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.182225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.182780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.306605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82259-0142-4da6-b1c2-9bb26d59a2c9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.312294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d763fa-1aba-47f9-91c7-4b9bf92d2101 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.341782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.342471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.342693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.342968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.343587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.343887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.345248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.349157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.354384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.354533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 458/908] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.354628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.354628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.354807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.359609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.361195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.368143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:45.373671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:45.374650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 451/909] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:45.375580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.442330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.458861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8038d7-aa0d-4bba-93f2-91c37cf47c33 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.494332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.494965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.495190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6aa436-910b-493b-abbc-62691c98cc77 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.495310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.495502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.496077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.497436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:45.506848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:45.507856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:45.508807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 459/910] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:45.510341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.536863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.537468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.537755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.538027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.538696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.538986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.540350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.545283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 452/911] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.546074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.608513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.632386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a4a8f-d7e8-4986-bbd9-a20b1700a788 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.665420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af744-b450-4f15-bbb1-0a4e73ca62ec None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.668943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.669819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.670334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.670806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.671705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.672213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.674243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.691049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.692565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 460/912] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.693329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.702319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49192-4d97-408b-946e-623447f347ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.702932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49192-4d97-408b-946e-623447f347ba None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.709876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49192-4d97-408b-946e-623447f347ba None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.709876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f49192-4d97-408b-946e-623447f347ba None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.709876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f49192-4d97-408b-946e-623447f347ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.709876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f49192-4d97-408b-946e-623447f347ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.709876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f49192-4d97-408b-946e-623447f347ba None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.711770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 453/913] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.712310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49192-4d97-408b-946e-623447f347ba None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.805343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fac576-e4fb-452f-8de6-e9a9a8cf3f0d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.820805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f49192-4d97-408b-946e-623447f347ba None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.839428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.840035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.840302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.840572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.841257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] RBAC: Adding query filter params (interface=public, service_id=d0aeafe0ea9341de984f247f343754df, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.841558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.842949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.848826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 461/914] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/endpoints?service_id=d0aeafe0ea9341de984f247f343754df&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.850847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.853702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.862810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:45.863607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:45.863887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:45.864157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:45.864875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] RBAC: Adding query filter params (role.id=4d91d989b91f4de2b0193a7e40d319d8, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=94795892e1d54081a2e10d2f55bb6a08) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:45.865180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:45.866637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:45.872091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 454/915] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/role_assignments?user.id=94795892e1d54081a2e10d2f55bb6a08&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4d91d989b91f4de2b0193a7e40d319d8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:45.872883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:45.942920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:45.981841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45777d43-1d84-4c2d-854c-633a739ef0aa None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:45.997563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d1bd5-fa3c-4d54-a50b-7c874122ce26 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.020677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.021206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.021489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.021763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.022438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.022742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.024149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.029988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 462/916] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:46.035871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.043073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.043687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.043966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.044239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.044844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.046317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5d4d-5a5a-48b1-a9a0-13ea1d28b1a0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.058342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 455/917] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:45 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:46.059805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5090-7b20-4d2e-9b8b-e0beac8dc095 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.060092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5090-7b20-4d2e-9b8b-e0beac8dc095 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.060467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5090-7b20-4d2e-9b8b-e0beac8dc095 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.061956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 456/918] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:46.070136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.070443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.070713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.102366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:46.104689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:46.110412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.161173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec2ca-fa1e-4312-927a-db84322f440c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.202206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 457/919] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:46.213416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.214028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.214338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.214614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.215279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.216651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.305852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 463/920] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:46.469204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.521347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.576095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d0b9-3c6f-4cdc-9779-349b3f97c0ea None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.616175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.616802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.617079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.617345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.617915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.619433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:46.628227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:46.629212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:46.630442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 458/921] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:46.635519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.739309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cdf21-80d7-4a03-93c4-a53fc8c94a73 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.764641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.776287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.776957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.777239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.777514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.778137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.778469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.779830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.785445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 464/922] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:46.791044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:46.902963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52036-0df4-423c-b39a-b074eaadb857 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:46.911148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:46.944609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:46.945570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:46.946041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:46.946533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:46.947370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:46.947886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:46.949447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:46.955589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 459/923] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:46.961681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.071618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38a9f-f683-4a30-94ed-fa4903ccc572 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.106911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.107579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.107863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.108134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.108861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] RBAC: Adding query filter params (interface=public, service_id=62027974692844ddaa2ce5ae933bc4ee, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:47.109171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.110563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d56d0-f8a5-4685-b079-781181195899 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.116686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 465/924] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:46 2022] GET /identity/v3/endpoints?service_id=62027974692844ddaa2ce5ae933bc4ee&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:47.122218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:47.229913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbccce-e573-4490-bd58-36811ff35f07 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:47.270160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:47.271152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.271646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.272114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.272910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:47.274526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011105e-d725-416a-a5dc-28d70dcd59f5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:47.281429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 460/925] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:47 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:27:47.900167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9714183-416e-43d0-ab17-9099d390a283 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.900684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9714183-416e-43d0-ab17-9099d390a283 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.900792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9714183-416e-43d0-ab17-9099d390a283 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.902304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 466/926] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:47.907953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523edb2-1438-4e09-ba96-d59b5d13128f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:47.908430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523edb2-1438-4e09-ba96-d59b5d13128f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:47.908515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523edb2-1438-4e09-ba96-d59b5d13128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:47.931299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a523edb2-1438-4e09-ba96-d59b5d13128f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:47.932513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a523edb2-1438-4e09-ba96-d59b5d13128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:47.964333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.007312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 461/927] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:48.066597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138685-e1f0-4fba-bd91-4bdeb23c8035 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.066915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138685-e1f0-4fba-bd91-4bdeb23c8035 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.067142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138685-e1f0-4fba-bd91-4bdeb23c8035 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.068729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 467/928] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:48.073900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a24a-4a73-43a6-bc32-fc6f9f6552af None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.074212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a24a-4a73-43a6-bc32-fc6f9f6552af None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.074491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5a24a-4a73-43a6-bc32-fc6f9f6552af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.093208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-68e5a24a-4a73-43a6-bc32-fc6f9f6552af None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:48.094424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-68e5a24a-4a73-43a6-bc32-fc6f9f6552af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:48.165064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 462/929] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:48.279419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138685-e1f0-4fba-bd91-4bdeb23c8035 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.312007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6d97-98d9-4bd3-bd18-b2f6086901ec None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.312353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6d97-98d9-4bd3-bd18-b2f6086901ec None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.312555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c6d97-98d9-4bd3-bd18-b2f6086901ec None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.314770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 463/930] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:48.319713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.319992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.320265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.333481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.338737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:48.339921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:48.387426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138685-e1f0-4fba-bd91-4bdeb23c8035 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.429594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 464/931] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:48.437802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.438476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.438755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.439046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.450478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:48.453746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:48.455682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:48.456616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:48.457443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 468/932] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:48.462765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.481813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.573702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4cc5-b439-4539-a53f-63e03be32436 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.582683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ac896-381b-497c-9aa9-432524b08999 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.584796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.608949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.609773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.610154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.610563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.611384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:48.611805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.613535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.626265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 469/933] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:48.628949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.631175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.631808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.632300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.632582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.633984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.635420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:48.646627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:48.647591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 12:27:48.648482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:48.652492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 465/934] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:48.654817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.745526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da5e8-23ee-4bf3-b7d2-86b39c997748 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.754859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.768042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e384-8e7f-4d4c-ba82-f9bbbf84c299 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.781515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.782258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.782630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.783527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.794376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.795813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.804252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.804751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.805029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.805303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.805929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:48.806257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.807611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:48.810706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:48.811613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:48.812566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:48.812566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:48.812566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:48.812566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 470/935] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:48.813432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.820550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 466/936] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:48.820550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.841259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:48.920335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98551e00-a25f-4ea8-926f-bce1b51bebf3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.928156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8d62-3910-41f2-bef6-6e708dcfba5d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:48.957589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.958606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.958902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.959149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.959775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.961195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.962678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:48.963299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:48.963572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:48.963822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING keystone.server.flask.common [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 12:27:48.963923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:48.964452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:48.964748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:48.966085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:48.978432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 467/937] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:48.979247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:48.993947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.021499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.sql.core [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:49.021499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 12:27:49.021499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [parameters: {'id': '712f5775825e480fa5db658d2e339952', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 12:27:49.021499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81881) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 712f5775825e480fa5db658d2e339952.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 712f5775825e480fa5db658d2e339952. Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:49.029288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 12:27:49.036290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application yield resource Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise self.value Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application session.commit() Aug 22 12:27:49.037493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:27:49.038666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:27:49.039812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:49.040783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [parameters: {'id': '712f5775825e480fa5db658d2e339952', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.041850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.043681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 712f5775825e480fa5db658d2e339952. Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 471/938] 10.222.0.15 () {60 vars in 1140 bytes} [Mon Aug 22 12:27:48 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:49.046562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.095144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035594-12df-45f6-a663-d3d19a888fdc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.128846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.131517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.132133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.132410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.132682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.133308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.133608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.134994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.139991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 468/939] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.145219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.155592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d955fb-288f-4637-ae75-72eaf08e9275 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.194755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.195450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.195729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.196004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.203227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.205226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:49.216914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:49.217885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.218865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 472/940] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:49.219453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.225408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.249619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3f6e-b6bb-4786-82eb-46a2011672b8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.286922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.287557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.288192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.288192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.294738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.296218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:49.312406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:49.313530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 469/941] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:49.314743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.333837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a746-121c-44e8-a5e4-b2a04efbae4e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.368259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.368864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.369139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.369407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.370052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.371452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.381454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.415067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd0c7-3be5-42cb-9771-a36ae6ecb7ba None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.447515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.448115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.448394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.449016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.449376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.449678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.451126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89faf-8b88-4e61-9c5e-84e98d2ed4c8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.453590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.468803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 470/942] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.469949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb5980-4e35-48ea-88d6-0b994e9f38d9 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.470258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb5980-4e35-48ea-88d6-0b994e9f38d9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.470575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb5980-4e35-48ea-88d6-0b994e9f38d9 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.471768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 471/943] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:49.472540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb5980-4e35-48ea-88d6-0b994e9f38d9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.498211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 473/944] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:49.498211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.599639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb5980-4e35-48ea-88d6-0b994e9f38d9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.600160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54fec-457b-4ecb-aebb-d46f93bc2bb6 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.639778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.640383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.640659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.640928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.641589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.641885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.643922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecfa1c-d1ae-4410-ae78-1dc5d12ee430 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.646620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.647264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.647896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.647896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.660522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.661969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.665259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 472/945] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:49.666652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.666946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.667218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:49.679169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:49.680243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:49.682395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:49.682395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:49.682395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:49.682395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 474/946] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:49.686809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.691061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:49.692626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:49.745576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.760535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:49.788951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 473/947] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:49.813158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59def0e-4709-47f5-b909-e56131c68e93 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:49.849975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:49.850528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:49.850865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:49.851141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:49.851831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:49.852140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:49.853508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:49.866606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 475/948] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:49.872197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:49.982676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747983b-0906-45d5-9e9d-3eeb5b4731c8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.027753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.028759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.029239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.029710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.037098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.038849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:50.052510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:50.054941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:50.057093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:50.059752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 474/949] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:50.065814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.069531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.124602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.175812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3382c5-f63a-4919-8395-75e14f4c3260 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.186663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.201791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501986-b675-4d5a-bfc9-1ff63c5c56bc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.222782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.223729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.224204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.225200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.226385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:50.226889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.229450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.240179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.240898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.241228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.241783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.242126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.243510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.245892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 476/950] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:50.252924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:50.257571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:50.258891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:50.259757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:50.263729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 475/951] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:50.264635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.381577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c3ab-7def-43d0-8867-08a93794f41f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.384641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.394493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562cfa0-30f7-43f3-9ec2-178727d98650 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.424586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.425690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.426205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.426943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.427990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:50.428466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.430015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.431350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.432282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.432485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.432879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/94795892e1d54081a2e10d2f55bb6a08/roles/4d91d989b91f4de2b0193a7e40d319d8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.435331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=94795892e1d54081a2e10d2f55bb6a08, role_id=4d91d989b91f4de2b0193a7e40d319d8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.436223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 476/952] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:50.441489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.441608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.518441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 477/953] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:27:50 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/94795892e1d54081a2e10d2f55bb6a08/roles/4d91d989b91f4de2b0193a7e40d319d8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:27:50.551000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74daa-be4e-4c3c-860b-8d855fcda2aa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.595359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.595989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.596271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.596544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.597193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:50.597495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.598943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983ed7-3276-46b4-9c7a-a682d933c8b1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.605019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 477/954] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:50.610757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:50.645901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:50.728617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409b74-434e-403d-947e-a03ef0a1faa6 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:50.763409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:50.764017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:50.764293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:50.764566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:50.765231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:50.766618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9855bc3-619f-49c4-8a7a-3c2b63fa9c9f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:50.854150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 478/955] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:27:51.509190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef703-88d3-4281-ace9-bb9af0d527c9 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.509737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef703-88d3-4281-ace9-bb9af0d527c9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.509737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef703-88d3-4281-ace9-bb9af0d527c9 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.511377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 478/956] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:51.516872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4558-cd2b-4496-bc55-2ff07aa79a83 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.517327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4558-cd2b-4496-bc55-2ff07aa79a83 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.517498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4558-cd2b-4496-bc55-2ff07aa79a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.536804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5d1d4558-cd2b-4496-bc55-2ff07aa79a83 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:51.538420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5d1d4558-cd2b-4496-bc55-2ff07aa79a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:51.614475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 479/957] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:51.777045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f842-e51a-4c99-9701-6f75c837f538 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.777363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f842-e51a-4c99-9701-6f75c837f538 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.777606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1f842-e51a-4c99-9701-6f75c837f538 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.779208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 479/958] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:51.785074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:51.785469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:51.785847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:51.804684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:51.805798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:51.808705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:51.877545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 480/959] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:51.906525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f842-e51a-4c99-9701-6f75c837f538 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:51.940152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.021471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1f842-e51a-4c99-9701-6f75c837f538 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.058210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.058767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.059045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.059315 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] PATH_INFO: `/v3/services/compute` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.059900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.061257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:52.070826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:52.071888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.073078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 480/960] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:52.078818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.181078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.196286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fec82-16e4-4a99-a895-a2416fff6623 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.236404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.237021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.237306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.237578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.238225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:52.238529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.240647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.247502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 481/961] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:52.253413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.268324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.300750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.307585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558337-b4ca-42e2-8c2b-5c811e2d2fab None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.347728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.348686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.349160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.349621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.350502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.352197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.355002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING keystone.server.flask.common [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 12:27:52.394320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85356b06-ddee-4a83-8b64-73223f4a5b1f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.399266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.sql.core [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:52.399266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 12:27:52.399266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [parameters: {'user_id': '82016173dc9346d3a61105c655ee5eb0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 12:27:52.399266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81882) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:52.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:52.423729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application yield resource Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application next(self.gen) Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise self.value Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application session.commit() Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 12:27:52.425584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.session.flush() Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application compat.raise_( Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 12:27:52.428182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 12:27:52.430719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application conn.query(q) Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application result.read() Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 12:27:52.432749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [parameters: {'user_id': '82016173dc9346d3a61105c655ee5eb0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:52.434232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 12:27:52.437875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 481/962] 10.222.0.15 () {60 vars in 1131 bytes} [Mon Aug 22 12:27:52 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:52.440517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.449433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.449433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.449433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.450451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.451374 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:52.451882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.453630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523ff3-c2a7-420f-a163-ccabc1635e18 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.461000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 482/963] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:52.558963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e592-01c2-47b2-ad01-b04ceb1a3030 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.576600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c65c7-f174-4cf3-be7a-764fc68f8fb6 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.577126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c65c7-f174-4cf3-be7a-764fc68f8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.577545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c65c7-f174-4cf3-be7a-764fc68f8fb6 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.585245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 483/964] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:52.586655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd5a9-579d-4b49-bc41-046c1f62ae0e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.586933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd5a9-579d-4b49-bc41-046c1f62ae0e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.587204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd5a9-579d-4b49-bc41-046c1f62ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.598553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.599120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.599397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.599668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.607847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6d8cd5a9-579d-4b49-bc41-046c1f62ae0e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:52.609060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6d8cd5a9-579d-4b49-bc41-046c1f62ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:52.615285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.618357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:52.633107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:52.634126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:52.635370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 482/965] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:52.642051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:52.694699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.695166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:52.703054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 484/966] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:52.761936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc101f2-f37f-4520-a69b-745cf6f28250 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:52.799158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:52.800788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.800788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.800788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.801127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:52.801345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:52.802812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f028-ba93-4b77-8402-284e68d12dfd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:52.844734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 483/967] 10.222.0.15 () {56 vars in 1101 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:52.926245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f804-78d3-48a2-8477-f12cdc091623 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.926541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f804-78d3-48a2-8477-f12cdc091623 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.926706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f804-78d3-48a2-8477-f12cdc091623 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.928071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 485/968] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:52.933869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:52.934214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:52.934464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:52.956072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:52.957632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:52.996723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f804-78d3-48a2-8477-f12cdc091623 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.047164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 484/969] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:53.125981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f804-78d3-48a2-8477-f12cdc091623 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.164082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.164716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.164994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.165264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.176532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:27:53.181119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.182235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:53.183394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 486/970] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:27:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:53.188135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.197669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.295014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb2c2-0f6c-47b0-b955-fb8327c52415 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.329440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.330346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.330603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.330725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.330894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.331526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.331823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.333180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.342708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 485/971] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.347990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.408544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.420663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.460942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8d63-79dd-4fb4-a0e1-ab5c7e60a004 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.463924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1e03-a3e0-439f-b1da-d2df4f9b9c27 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.496170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.496832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.497111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.497384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.502786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.503417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.503692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.503964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.504542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.505912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.509212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.510675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.515327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.516281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:53.517123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 487/972] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:53.523646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:53.531029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.531957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:53.533456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:53.533456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:53.533456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:53.533456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 486/973] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:53.538760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.638746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ebd6c-f3d1-414a-bea0-e0c7ccc89bc3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.651001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7cf0-20cf-431d-bfd8-98325b1ee483 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.662128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.671055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.673877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.674523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.674799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.675071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.675696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.675996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.677353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.686586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 488/974] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:53.687584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.690752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.691369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.691725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.692001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.692647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.692947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.694330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.711334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 487/975] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:53.716630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.796752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc93a36-e837-4d1c-9418-91a3f0dbd64b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.820531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ed48-bd41-4f65-ad78-6017fade9753 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.835683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.836571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.837012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.837280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.837900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.838209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.839565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.845707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 489/976] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:53.851266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.857281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.858372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.858828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.859273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.868851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.870854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:27:53.883593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:53.884545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:53.885976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 488/977] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:53.890308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:53.905601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.933073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:53.960490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230511e-d974-4fc3-8446-ebc0b614d64a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.993659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ad0a-3755-4d71-9344-0ba9fa6768c4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:53.996502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:53.996639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:53.996881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:53.997144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:53.997855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] RBAC: Adding query filter params (interface=admin, service_id=62027974692844ddaa2ce5ae933bc4ee, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:53.998159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:53.999554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.011591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 490/978] 10.222.0.15 () {56 vars in 1249 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/endpoints?service_id=62027974692844ddaa2ce5ae933bc4ee&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:54.013297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.037541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.038627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.038908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.039348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.040081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:54.040383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.041811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.063113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 489/979] 10.222.0.15 () {56 vars in 1149 bytes} [Mon Aug 22 12:27:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:54.068502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.125055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390b930-2eb5-4c36-9c75-1151c7356bec None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.139328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.160762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.161368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.161648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.161914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.162604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.164018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.170884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 491/980] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:27:54.186946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.191884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6756b2-2223-40fc-9d32-964190c841dc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.231300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.231919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.232195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.232465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.314694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.316146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327294-fdf4-4e04-bbc7-32f49b0bfced None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.415475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.424565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 490/981] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:27:54.430429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.433094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb83b-4302-41af-9274-af124cd5ec9a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.433383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb83b-4302-41af-9274-af124cd5ec9a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.433658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb83b-4302-41af-9274-af124cd5ec9a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.435166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 491/982] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:27:54.439917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.440197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.440509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.459213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:54.460415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:54.533386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 492/983] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:54.544261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee65e5-2743-484c-88ed-4b8473488c8b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.579494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.580830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.581325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.581998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.593127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.594850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:27:54.609734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:54.610733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:27:54.612293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:27:54.612293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:27:54.612293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:54.612765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 492/984] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:54.617937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.723427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8721ed-b740-461c-ae50-9e56322b9512 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.750666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.759334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.759947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.763701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.763701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.763701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:54.763701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.763701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.778574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 493/985] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:54.780114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.804195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:54.813663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:54.891158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18feb8-3027-4c78-bc1c-9f51ca606a5e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.909789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7f72-8825-49f5-a38c-6c1e656ce183 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:54.926153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.926789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.927061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.927335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.933767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.935225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.946002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:27:54.946231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:54.947299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:54.948364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 493/986] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:54.949480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:54.949759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:54.950030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:54.950692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:54.952135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:54.953105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.025928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 494/987] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:54 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:55.053080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:55.063942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f181f5-55f7-4eed-ba66-286258e6f7ac None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.109646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.110294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.110626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.110926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.111622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:55.111922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.113363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2e859-c8f2-4a59-9463-bf72b291463e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.131679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 494/988] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:55.133606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:55.191325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:55.243484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46b615-d2a7-4066-a115-b7eec3067ede None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:55.283822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:55.284793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:55.285301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:55.285794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:55.286778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] RBAC: Adding query filter params (role.id=4d91d989b91f4de2b0193a7e40d319d8, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=94795892e1d54081a2e10d2f55bb6a08) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:55.287301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:55.289576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ce68-8898-4e47-b406-f2b87b2ad21c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:55.296186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 495/989] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:27:55 2022] GET /identity/v3/role_assignments?user.id=94795892e1d54081a2e10d2f55bb6a08&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4d91d989b91f4de2b0193a7e40d319d8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:56.145194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648351-11c0-4c36-adc0-8b347a92fdce None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.145717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648351-11c0-4c36-adc0-8b347a92fdce None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.146009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648351-11c0-4c36-adc0-8b347a92fdce None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.148193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 495/990] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:56.154843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.155407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.155407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.183546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:56.184803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:56.253239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 496/991] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:56.525872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648351-11c0-4c36-adc0-8b347a92fdce None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.632733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648351-11c0-4c36-adc0-8b347a92fdce None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.668114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.669057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.669518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.669971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.670755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.672335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:56.681988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:56.682982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 12:27:56.683840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:27:56.686100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 496/992] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:27:56.691673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.737165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.793773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9390d0-0678-424e-875f-b4f49b3d7968 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.829230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.829872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.830417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.830702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.831326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.831625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.833005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2e51-0cc1-4616-babe-9448429b385b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.838095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 497/993] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:56.843623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:56.857601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:56.946225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01e91-4d03-46f9-9921-9d7c97525efa None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.946714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01e91-4d03-46f9-9921-9d7c97525efa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.947096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e01e91-4d03-46f9-9921-9d7c97525efa None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.948685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5075-caab-4dc3-bb36-891ecb7d89c8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:56.948824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 498/994] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:56.955139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea44a2-237c-4e79-bdfd-e9bcdace83d5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.955673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea44a2-237c-4e79-bdfd-e9bcdace83d5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.955941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea44a2-237c-4e79-bdfd-e9bcdace83d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.975710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f7ea44a2-237c-4e79-bdfd-e9bcdace83d5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:56.976900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f7ea44a2-237c-4e79-bdfd-e9bcdace83d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:56.984971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:56.985569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:56.985841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:56.986133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:56.986781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:56.987261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:56.988417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:56.993528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 497/995] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Aug 22 12:27:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:56.999000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.047488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 499/996] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:27:57.082381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:57.107935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537483-70dc-453a-96c4-d77e12323185 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.142970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.143577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.143881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.144153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.144805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.146250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbce2b-0f52-407b-9974-e6db0f7dea8e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.216791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 498/997] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:27:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:27:57.222921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55091-e853-40a1-980f-b5d76d5ed095 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.226304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55091-e853-40a1-980f-b5d76d5ed095 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.226304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55091-e853-40a1-980f-b5d76d5ed095 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.226304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 500/998] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:57.230935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.231221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.231494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.250862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:57.252624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:57.318590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55091-e853-40a1-980f-b5d76d5ed095 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.341482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 499/999] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:57.362255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:57.432149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55091-e853-40a1-980f-b5d76d5ed095 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.467204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.467837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.468116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.468396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.468959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.470916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:57.479986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:57.480957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.481808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 501/1000] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:57.487574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.549751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:57.590629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704db501-3fa9-4072-86ce-5572990defa9 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.609556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.635794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.636406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.636682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.636952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.637692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:57.637994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.639405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.650848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 500/1001] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:57.652919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.744545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:57.747513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d73b9-520a-43ec-a4be-ad3286886263 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.773092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911f1e-e64c-4c98-973c-5fcdf68c148e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.785829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.786464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.786814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.787196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] PATH_INFO: `/v3/services/image` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.787824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.789511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:27:57.804872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:27:57.806142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:27:57.807136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 502/1002] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:27:57.811785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.813373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:57.824351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.825035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.825314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.825584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.826220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:57.826520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.827987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.838221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 501/1003] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:27:57.843537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:57.925704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8692cee-3e7a-42b4-a5aa-49ba58a8367d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.971923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:57.972539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:57.972815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:57.973086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:57.973708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:57.974004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:57.975655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:57.981446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 503/1004] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:57.981768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca958-12fe-4ce6-86cc-08512affb0bc None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:57.987184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.023877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.027274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.027886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.028161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.028449 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.029133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] RBAC: Adding query filter params (interface=public, service_id=418c2bc581104581b8a4cf462edc5d83, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:58.029438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.030929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.036920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 502/1005] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/endpoints?service_id=418c2bc581104581b8a4cf462edc5d83&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:58.042436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:58.105796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:58.110252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d049a-bfb0-4672-8685-0d81f7cdc9bf None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.151216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.152228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.152753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.153238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.154498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] RBAC: Adding query filter params (type=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:27:58.155041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.157576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d764a-8e8a-4205-a4f2-80a7c1924d9e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.161003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b50ab7-087d-4b62-86d5-8f80a881637c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:58.165617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 504/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:58.199258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:58.199887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:58.200163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:58.200431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:58.201094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:58.202450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e27a-e310-46e1-938b-9a8c80126627 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:58.210049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 503/1007] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:27:58 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:27:59.154961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072021f-d25b-4fc5-8bbd-ca501393c25e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.155501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072021f-d25b-4fc5-8bbd-ca501393c25e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.155501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072021f-d25b-4fc5-8bbd-ca501393c25e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.157000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 505/1008] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:27:59.162899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.163318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.163506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.181751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:27:59.182967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:27:59.253040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 504/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:27:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:27:59.517054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072021f-d25b-4fc5-8bbd-ca501393c25e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.613636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:59.623841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072021f-d25b-4fc5-8bbd-ca501393c25e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.657916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.658580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.658857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.659130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.660247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.661674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b2c0-9bc0-4097-aaa1-380e33877b7f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.666222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 506/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:27:59.669175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:27:59.717769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:27:59.774874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14081ed-9f93-4ea1-ad6c-cafb494f0aa4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:27:59.807810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:27:59.808409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:27:59.808685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:27:59.808950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:27:59.809591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:27:59.811031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027829f2-8db1-44d2-93c2-6c2f15a7728b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:27:59.938215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 505/1011] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:27:59 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:00.067902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ccd0-92ec-4746-af75-a945bee317e5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.068293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ccd0-92ec-4746-af75-a945bee317e5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.068468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ccd0-92ec-4746-af75-a945bee317e5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.069934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 507/1012] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:00.076915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.077196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.084791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.098692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:00.100573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:00.149745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d3ba-b6bd-4c6a-b815-5ab50b040a45 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.150022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d3ba-b6bd-4c6a-b815-5ab50b040a45 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.150397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d3ba-b6bd-4c6a-b815-5ab50b040a45 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.151745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 508/1013] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:00.156923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.157463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.157463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.174970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 506/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:00.179672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:00.181085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:00.248038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 509/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:00.445908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:00.474583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:00.523055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:00.562828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f25e-8715-4585-a849-ad082f01fa14 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:00.598785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:00.599392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.599670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.599941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.600587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:00.601951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:00.622605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:00.632961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0372da-58fc-4aaa-a920-9e41cdf2004c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:00.668452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:00.669079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.669359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.669631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.670226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:00.671624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:00.680131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:00.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:00.682542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 510/1016] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:00.686987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:00.702298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 507/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:00 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:00.806490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c8865-5eb5-4037-a243-71cc487bad0f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:00.856793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:00.857875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:00.858156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:00.858452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:00.859074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:00.859429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:00.860804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:00.866378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 511/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:28:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:00.872231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:00.966222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:00.978901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae622-33d5-44e4-82a9-26c5bb5e3749 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.013161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a726b-9530-4299-8b01-b29646510975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.013772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a726b-9530-4299-8b01-b29646510975 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.014047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a726b-9530-4299-8b01-b29646510975 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.014347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a726b-9530-4299-8b01-b29646510975 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.015030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a726b-9530-4299-8b01-b29646510975 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:01.015333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a726b-9530-4299-8b01-b29646510975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.016681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a726b-9530-4299-8b01-b29646510975 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.023005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 508/1019] 10.222.0.15 () {56 vars in 1112 bytes} [Mon Aug 22 12:28:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:01.028917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:01.045160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:01.137180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0336ec7-ee5b-4190-a82d-6d6493245f2e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:01.173263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:01.174497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.174845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.175248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.177466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:01.177702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46fc93-9fb6-4caf-98cb-e7cbaf1022fb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:01.256861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 512/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:28:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:01.931131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa73b-3241-43e1-824c-755bc3b1070b None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.931647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa73b-3241-43e1-824c-755bc3b1070b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.931753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa73b-3241-43e1-824c-755bc3b1070b None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.933164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 509/1021] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:01.938275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:01.938635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:01.938986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:01.957142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:01.958383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:02.020450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.031148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 513/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:02.312064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fa73b-3241-43e1-824c-755bc3b1070b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.412041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fa73b-3241-43e1-824c-755bc3b1070b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.446443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.447098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.447374 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.447644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.448831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.450298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013407a6-fb41-467d-9b58-396bf7cdec9b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.452069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 510/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:02.457910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:02.570922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217b29f-b67a-4cf6-80bf-a79cfee394cc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:02.605591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:02.606218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.606500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.606772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.607420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:02.608843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:02.653353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e960ea-96e3-4fd8-926c-f649b40d6cf2 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.653637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e960ea-96e3-4fd8-926c-f649b40d6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.653915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e960ea-96e3-4fd8-926c-f649b40d6cf2 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.655336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 511/1024] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:02.660339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:02.660620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:02.660895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:02.678437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:02.679605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:02.693879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:02.714378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 514/1025] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:02 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:02.755285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 512/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:03.027790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.084676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.133967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501bd6d-261f-470c-83a9-ef505b909a56 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.167984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.168619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.168898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.169168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] PATH_INFO: `/v3/services/image` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.169754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.171149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1adf35ec-0180-4112-9364-b8497126bb3d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:03.180323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:03.181353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:03.182269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 515/1027] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:03.188199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.275689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55b7c-c810-49b2-9e91-53333d8b6dcc None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.276009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55b7c-c810-49b2-9e91-53333d8b6dcc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.276232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55b7c-c810-49b2-9e91-53333d8b6dcc None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.277570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 516/1028] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:03.299625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.299625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.299625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.300428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021ba7f-dd95-49f2-9445-42c2869e92e6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.301526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:03.302729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:03.334483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.335087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.335362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.335635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.336244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.336541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.337902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.342961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 513/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:03.349117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.366325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.374047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 517/1030] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:03.453036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14959736-1389-4598-8e83-9090175fbbf7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.487036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.487638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.487917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.488186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.488798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.489096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.490474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.495345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 514/1031] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:03.501200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.547328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.602688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed8af8-b3d0-4ba2-9465-6a8928c1b530 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.636201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.636803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.637081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.637353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.638042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] RBAC: Adding query filter params (interface=public, service_id=57658f868cbc4c298d5cc619de87d301, region_id=RegionOne) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.638382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.639738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.645335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 518/1032] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/endpoints?service_id=57658f868cbc4c298d5cc619de87d301&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:03.651077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.669914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.736692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.760128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46794f-7627-4aee-adcc-ffe387af6ba5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.783180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084987b-831d-4371-aee2-d399934f9861 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.793987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:03.797993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.799165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.799444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.799714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.800306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:03.801667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:03.815157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 515/1033] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:28:03.820936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.821615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.821894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.822169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.835866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:03.840772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:03.841866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:03.847342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 519/1034] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:03.848907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:03.962444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402d13-1ed3-4dd6-819c-5b28d214918d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:03.996915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:03.997521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:03.997806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:03.998075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:03.998758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:03.999058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.000418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.010025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 516/1035] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:04.015632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.123109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3c9a7-4fb8-416f-a22b-bddb4d4b0827 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.159711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.160335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.160608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.160875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.171459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.172889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:04.186793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:04.187738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:04.194024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:04.194024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:04.194024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:04.194024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 520/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:04.195924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.200774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.310511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43498e8-6e8e-458f-a85d-88de6dcf57a7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.345731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.346373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.346654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.346924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.347554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:04.347850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.349216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.362092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 517/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:04.367692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.393618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.470582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f806-6f08-492c-959d-6b9f5096a6c9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.504617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.505252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.505516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.505791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.513332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.514810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8e13ccf4-3ead-4800-8efe-294e4c51efa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:04.526457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:04.527423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:04.528397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:04.530268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 521/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:04.534315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.599711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.641834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e374d3d-eebe-4c89-ace4-8497dd643dc4 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.662524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d76a8-a6de-45b4-a374-94fda3a5787d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.662807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d76a8-a6de-45b4-a374-94fda3a5787d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.663076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d76a8-a6de-45b4-a374-94fda3a5787d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.664403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 522/1039] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:04.669208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.669486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.669766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.679334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.680175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.680650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.681114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.682012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:04.682514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.684894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:04.688271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:04.689495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:04.707841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 518/1040] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:04.713981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:04.761156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 523/1041] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:04.826517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb4f95-0285-4fae-aad8-db5ac9f9fb6f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:04.852072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:04.866358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:04.866969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:04.867243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:04.867518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:04.936307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:04.937776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.023617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.041920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 519/1042] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:05.042109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.043798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.071329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.127656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fec9-8cc9-40ed-af3b-c7bda09f1e0c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.152373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926f248-ad8b-4cdc-94d6-7f17ba62ef7d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.167948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.168594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.168870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.169138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.179836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:05.184494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:05.185651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:05.186874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 524/1043] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:05.191561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.200630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.202173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.202645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.216847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.218318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:05.234680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:05.235668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:05.242537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:05.242537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:05.242537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:05.242537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 520/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:05.242537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.275205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.310264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f376-f955-49ff-b5f9-9de92fe10417 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.327972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.348340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.349110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.349386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.349660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.350342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.350648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.352085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.352767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aee9a-b7ca-4203-b574-c762b69a157a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.362409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 525/1045] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:05.367853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.394319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.394860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.395139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.395409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.396044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.396345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.397709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.409684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 521/1046] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:05.415232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.479090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46897ad-3336-45ca-a8af-6c5983c366ce None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.514149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.514801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.515074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.515353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] PATH_INFO: `/v3/users/ac4e2223ab4d4451908761482d433391` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.517800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.530574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ac4e2223ab4d4451908761482d433391)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.532110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.534066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 526/1047] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/users/ac4e2223ab4d4451908761482d433391 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:05.539226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c67c-1f72-44b8-97c4-dcaeac8468c0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.539668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.578706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.579566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.580813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.581088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.583076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.588894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.593740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:05.601670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:05.602620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:05.603622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 522/1048] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:05.609590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.658220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e181a4-768d-40e6-9985-1ebaaa4b96f9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.698553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.699168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.699443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.699713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.727728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27406-6d87-4b94-b400-1745437ba377 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.774052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.774688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.774968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.775240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.775925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.776227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.777654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b0963-51e1-4f10-b531-b433fe99877a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.780391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.790939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.791072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 523/1049] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:05.792232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b2d5-6805-4dcd-af7d-2e01f85b4482 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.802002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3d8b-a7b4-4173-b029-7632fed7db6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.802129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b2d5-6805-4dcd-af7d-2e01f85b4482 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.802129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b2d5-6805-4dcd-af7d-2e01f85b4482 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.802129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 524/1050] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:05.802129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74b2d5-6805-4dcd-af7d-2e01f85b4482 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.852366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:05.894447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 527/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:05.895693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.895987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.896260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.897495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74b2d5-6805-4dcd-af7d-2e01f85b4482 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:05.913341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:05.914485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:05.932315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:05.932910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:05.933187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:05.933452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:05.934163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] RBAC: Adding query filter params (role.id=4d91d989b91f4de2b0193a7e40d319d8, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:05.934497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:05.935904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:05.941315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 525/1052] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4d91d989b91f4de2b0193a7e40d319d8 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:05.941959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:05.995586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 528/1053] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:06.052076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5869277-4342-40f5-8db3-47940e24a1f9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.071164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.091526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.092172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.092450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.092725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.093845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.095948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.099301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 526/1054] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:05 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:06.103747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.128985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.206670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5f9db-e61a-4377-99d8-fb7440c76c8f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.242868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.243479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.243755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.244027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.244746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a, user.id=ac4e2223ab4d4451908761482d433391) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:06.245052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.246502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.257712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 529/1055] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/role_assignments?user.id=ac4e2223ab4d4451908761482d433391&scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:06.274054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.381109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce2ec8-8425-494c-879e-b5f94be362a9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.417268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.417900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.418194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.418475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] PATH_INFO: `/v3/services/image` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.419050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.420409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:06.429288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:06.430623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 12:28:06.431789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:06.434279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 527/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:06.436324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.525206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.539812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a957c-0ac9-47fa-9b5b-0fdc1574d89d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.574087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.574896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.575180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.575454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.576079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] RBAC: Adding query filter params (name=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:06.576379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.577742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.583784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 530/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:06.589483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.643066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:06.693088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84e9a5-633b-40dc-9710-9e332032584a None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.726503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.727105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.727379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.727648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.728263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] RBAC: Adding query filter params (type=image) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:06.728559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.729913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e5160-704a-46bb-9274-e841c6631efc None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.739907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 528/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:06.741115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:06.842858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5565-84e9-4ebd-a7d3-13ba6ac1081f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:06.877071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:06.877680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:06.877956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:06.878247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:06.878899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:06.880247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b450c9c-ea9e-49ef-bce7-2a2de89ae6bd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:06.971165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 531/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:28:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:07.846147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c3f3f-cb77-4a2d-890d-10ef7a8d3466 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.846690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c3f3f-cb77-4a2d-890d-10ef7a8d3466 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.846690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c3f3f-cb77-4a2d-890d-10ef7a8d3466 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.848085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 529/1060] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:07.853081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2f6-8071-4718-8acb-03d1ca93fee8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:07.853452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2f6-8071-4718-8acb-03d1ca93fee8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:07.853639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5d2f6-8071-4718-8acb-03d1ca93fee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:07.866918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:07.872303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-eea5d2f6-8071-4718-8acb-03d1ca93fee8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:07.873478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-eea5d2f6-8071-4718-8acb-03d1ca93fee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:07.948012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 532/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:08.154564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38c22-716b-402a-b8ae-51ad1586af93 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.154885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38c22-716b-402a-b8ae-51ad1586af93 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.155060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38c22-716b-402a-b8ae-51ad1586af93 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.156519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 530/1062] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:08.161493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.161784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.162062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.181361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:08.182592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:08.220087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38c22-716b-402a-b8ae-51ad1586af93 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.253257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 533/1063] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:08.335351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38c22-716b-402a-b8ae-51ad1586af93 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.349190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.369218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.369843 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.370125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.370425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.380830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:08.385535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:08.386459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:08.387344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 531/1064] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:08.394340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.456734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.495939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf450-8b4c-4d93-a65f-ead4111d258f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.519647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.532574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.533217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.533550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.533829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.534531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:08.534835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.536208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.544298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 534/1065] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:08.549896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.628006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513253-e658-4661-a8e5-ff1f15dde8e7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.659952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aaf11-c2af-4f7c-9093-12ae0f8187be None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.662812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.663441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.663719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.663988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.675022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:08.679787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:08.680744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:08.681584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:08.685910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 532/1066] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:08.686892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.687013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.699300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.699939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.700217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.700491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.712106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.713491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.723018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:08.730004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:08.731281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:08.732382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:08.732382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:08.732382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:08.732382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 535/1067] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:08.737318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.797477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c21a0-80eb-45df-87e5-1ff85864c0de None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.833701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.834421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.834777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.835054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.835712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:08.836013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.837376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.844919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c3d6-a128-42d5-8f25-118d209dcc09 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.850223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 533/1068] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:08.852112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.884056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.884764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.884929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.885209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.885844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:08.886144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.887532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.900336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 536/1069] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:08.905887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:08.940878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.952730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:08.958757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374cac0-ba07-4a18-888e-a137cd23f3c9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:08.993260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:08.993260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.993260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.993260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] PATH_INFO: `/v3/users/ac4e2223ab4d4451908761482d433391` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:08.994450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] RBAC: Authorizing `identity:get_user(user_id=ac4e2223ab4d4451908761482d433391)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:08.995887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a7405-be40-4779-8309-93ef9eee5e64 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:08.997490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 534/1070] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/users/ac4e2223ab4d4451908761482d433391 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:08.998722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31807c2-8781-4c8a-9b9b-115655ab1009 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:08.999009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31807c2-8781-4c8a-9b9b-115655ab1009 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:08.999283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31807c2-8781-4c8a-9b9b-115655ab1009 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.000490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 535/1071] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:09.006705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31807c2-8781-4c8a-9b9b-115655ab1009 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.013981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a42f6-4603-4907-affa-3295f8baf211 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.048138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.049261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.049536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.049802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.058000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.059470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-fad6e963-4111-4394-b190-6c8deb0f8bc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:09.072135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:09.073148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:09.074093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 537/1072] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:09.074716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.074716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.074941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.092214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:09.093396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:09.111628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31807c2-8781-4c8a-9b9b-115655ab1009 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.145419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.146040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.146343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.146610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.147756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.149359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.150998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 536/1073] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:09.151749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.160800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 538/1074] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:09.161603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.191404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.191560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.268113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79af2a-bca7-4d06-97f2-a34364e60cae None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.274440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2756a-7ea6-4ab8-bfd4-b15b841556a1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.308263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.308894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.309169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.309445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.310162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:09.310472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.311883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.314883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.315634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.315908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.316173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a/users/ac4e2223ab4d4451908761482d433391/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.318054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a24f46c3cacb4d8c95b881f8370cc93a, user_id=ac4e2223ab4d4451908761482d433391, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.319498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.329287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 537/1075] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:09.335076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.384216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 539/1076] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:09 2022] PUT /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a/users/ac4e2223ab4d4451908761482d433391/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:09.427377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.429534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.442638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ad26-a90e-4c1b-aea8-ea4b804df7e1 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.483502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.484139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.484411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.484695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.496269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.497721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:09.513928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:09.515002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:09.515879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:09.515879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:09.515879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:09.515879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 538/1077] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:09.523206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.529585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.543533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c0cb4-f095-412e-b391-f1e8a2e745b3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.580809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.582230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.582531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.582788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.627459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78322521-8d2f-4ec2-bf1c-ee53bcf12921 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.655348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.657145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.661228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.661827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.662100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.662414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.663044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:09.663338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.664681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.677674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 539/1078] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:09.683206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.685935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.748672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.766231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 540/1079] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:09.772113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.789613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8c11-ae7c-4d8d-903e-ea07c7abdf8d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.827305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.828044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.828431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.828714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.836658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.838102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:09.853454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:09.854973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:09.856481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 540/1080] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:09.861006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.878617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc44b6-60ff-460d-9919-ac687c9ee49f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.915199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:09.915840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:09.916094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:09.916366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:09.928348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:09.929063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:09.930043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:09.945635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:09.946690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:09.948188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:09.948188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:09.948188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:09.948188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 541/1081] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:09.952561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:09.972970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23601dde-ba4e-457f-8fa3-7e52470ece58 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:09.997054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:10.006620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.007248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.007524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.013005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.013005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:10.013005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.013005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.022705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 541/1082] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:10.028698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:10.062880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a32f14-fb5c-4905-8cd0-5c79501e686b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.099997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.100594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.100869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.101136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.101785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:10.102053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.103434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982c35-b7a4-457d-81fe-a58077367af8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.116184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 542/1083] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:10.148918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a34e8-caa3-4c74-8bf3-cca7ade1800d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:10.175746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:10.187467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:10.188145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:10.188420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:10.188692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/4d91d989b91f4de2b0193a7e40d319d8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:10.191571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=2a09e02d84674a8282737d0411be459e, role_id=4d91d989b91f4de2b0193a7e40d319d8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:10.193024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18475fa-c86e-4e1c-8006-ccdbf111cdb7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:10.265483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 542/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:10 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/2a09e02d84674a8282737d0411be459e/roles/4d91d989b91f4de2b0193a7e40d319d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:28:11.295638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846755f-1a76-4cb3-b3eb-790a18d229bb None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.296033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846755f-1a76-4cb3-b3eb-790a18d229bb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.296176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846755f-1a76-4cb3-b3eb-790a18d229bb None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.297522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 543/1085] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:11.302805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.303224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.303344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.321024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:11.322198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:11.397805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 543/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:11.668956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846755f-1a76-4cb3-b3eb-790a18d229bb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.766167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.771416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846755f-1a76-4cb3-b3eb-790a18d229bb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.803708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.804331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.804603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.804871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.815658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:11.820277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:11.821390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:11.822294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 544/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:11.828235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:11.924587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c7943-6938-4438-b898-a79aa228f6ed None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:11.937327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:11.958643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:11.959250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:11.959524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:11.959794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:11.960444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:11.960744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:11.962101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:11.971110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 544/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:11.976958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.076169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd54b38-1482-4405-af97-605305a21f04 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.109039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.109687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.109968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.110260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] PATH_INFO: `/v3/users/ac4e2223ab4d4451908761482d433391` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.111365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] RBAC: Authorizing `identity:get_user(user_id=ac4e2223ab4d4451908761482d433391)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.112786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d881-fbce-4019-a77a-b4e40221fd8b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.114426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 545/1089] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:11 2022] GET /identity/v3/users/ac4e2223ab4d4451908761482d433391 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.120281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.185153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e6d8-d986-434d-be2a-84d4b5fed767 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.185357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e6d8-d986-434d-be2a-84d4b5fed767 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.185625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e6d8-d986-434d-be2a-84d4b5fed767 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.186982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 546/1090] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:28:12.191832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.192107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.192378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.210528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:12.211700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:12.218116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086af1ec-5023-4f11-bbcd-0e7a1382556b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.236231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.256662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.257256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.257531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.257803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.281112 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 547/1091] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:28:12.305282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.331032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.332789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.427808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 545/1092] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:12.433710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.530287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111292-c5fd-4a7a-bd34-a5bb126aeb17 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.554673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.562772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.563401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.563675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.564439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.565552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.567225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.568618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 548/1093] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:12.574446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.599369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.631483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.655481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711a398-02d3-4aba-ad57-9485b904efa5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.673899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08434cf-c722-49c7-939a-1b7c652834ac None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.688771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.689922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.690268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.690501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.700399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:12.705521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:12.706917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:12.707795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 546/1094] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:28:12.708523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.708523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.708677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.708960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.709539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a, user.id=ac4e2223ab4d4451908761482d433391) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:12.709915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.711368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.712750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.730265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 549/1095] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/role_assignments?user.id=ac4e2223ab4d4451908761482d433391&scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.817997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad612e6-3606-49e9-8e9d-37de713e2781 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:12.853958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:12.854603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:12.854882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:12.855155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:12.855810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:12.856112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:12.857476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:12.859027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.866605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 547/1096] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:12.872370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:12.961455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:12.973886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f150ef-8b91-45fc-b253-0a2379aa49d1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.007045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.007670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.007946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.008216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.018613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.020050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:13.034229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:13.040266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:13.041204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:13.041204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:13.041204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:13.041204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 550/1097] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:13.041432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:13.136969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815e11b-60f6-403e-9ec1-ac350c6e4c3d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.169411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.170009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.170312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.170582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.171203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:13.171496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.172845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.183756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 548/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:13.190005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:13.288960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ba41-972e-45b0-85d9-93c19e1e33e6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.322678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.323301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.323575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.323840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.332128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.333542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.336063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:28:13.344766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:13.345893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:13.347105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 551/1099] 10.222.0.15 () {56 vars in 1093 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:13.351811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:13.406485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:13.448771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1aedc-9e3a-49df-9ffb-dab874b7dbe3 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.480475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.481067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.481340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.481606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.482348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:13.482648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.484051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.500722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 549/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:13.507262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:13.611596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd239-e455-4be3-b400-34653b369f23 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.643887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.644478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.644750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.645016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.708532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:13.711195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.712962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.812422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 552/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:13.818999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:13.917097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685546f-3270-4e01-9868-ee648ff23683 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:13.930991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:13.949741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:13.950388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:13.950663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:13.950927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:13.961119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:13.962634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:13.977559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:13.978798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:28:13.980110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:13.980110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:28:13.980110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:13.982348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 550/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:13.984453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:14.077765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:14.081129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9430d5-4a19-40e9-b027-35c2370f17b3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:14.114451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:14.115046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.115321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.115589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.116212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:14.116508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:14.117851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:14.129033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 553/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:14.134680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:14.231182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c85c-5c10-4adc-9d35-792a79cbb1aa None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:14.265388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:14.266022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.266331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.266606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.273496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:14.274957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:28:14.285992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:14.286950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:14.287864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 551/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:14.292854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:14.397494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec54a-a32b-4ad5-a1c8-fb943ba9cb5c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:14.430412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:14.431009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.431286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.431558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.432237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:14.432542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:14.433963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8fc5a-038e-403a-b52f-fdca4a479a08 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:14.446435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 554/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:14.452270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:14.479838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:14.550386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e31e2-f52f-4a01-98b1-016bb866e41b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:14.583190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:14.583779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.584051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.584317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.585016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] RBAC: Adding query filter params (role.id=4d91d989b91f4de2b0193a7e40d319d8, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=2a09e02d84674a8282737d0411be459e) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:14.585313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:14.586745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e691a-68c9-429f-9d46-01295064b38d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:14.592387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 552/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:14 2022] GET /identity/v3/role_assignments?user.id=2a09e02d84674a8282737d0411be459e&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4d91d989b91f4de2b0193a7e40d319d8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:14.654807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa8ee-a3a1-4283-90d6-d26dd3821b45 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.655354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa8ee-a3a1-4283-90d6-d26dd3821b45 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.655354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fa8ee-a3a1-4283-90d6-d26dd3821b45 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.656913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 555/1107] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:14.663036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:14.663318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:14.663590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:14.682832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:14.684043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:14.753060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 553/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:15.018137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fa8ee-a3a1-4283-90d6-d26dd3821b45 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.040612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:15.128297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fa8ee-a3a1-4283-90d6-d26dd3821b45 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.163267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.163924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.164202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.164470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.165587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.167040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d705c2-c52a-4877-913f-e75b7411e1c0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.168818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 556/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:15.174957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:15.197789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:15.278969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c5ff8-f6dd-4fac-8c3d-5b015f168ac1 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:15.315836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:15.316445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:15.316721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:15.316987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:15.317653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:15.319139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0898a-767b-423e-900c-da36266ebb7a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:15.421853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 554/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:15 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:17.354758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe8a4-de6e-4b7d-9344-8cd1e877ffd2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.355254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe8a4-de6e-4b7d-9344-8cd1e877ffd2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.355351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe8a4-de6e-4b7d-9344-8cd1e877ffd2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:17.356620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 557/1111] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:17.362421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.362835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.362955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:17.380983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:17.382145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:17.445376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 555/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:17.712789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe8a4-de6e-4b7d-9344-8cd1e877ffd2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:17.799192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:17.811573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe8a4-de6e-4b7d-9344-8cd1e877ffd2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:17.846375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317df39-087f-476a-9317-23633fb3951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:17.846994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317df39-087f-476a-9317-23633fb3951c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.847268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317df39-087f-476a-9317-23633fb3951c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.847538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317df39-087f-476a-9317-23633fb3951c None admin] PATH_INFO: `/v3/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:17.848924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317df39-087f-476a-9317-23633fb3951c None admin] RBAC: Authorizing `identity:get_role(role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:17.850301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317df39-087f-476a-9317-23633fb3951c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:17.851606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 558/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:17 2022] GET /identity/v3/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:17.857382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:17.866066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:17.953241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009027d7-1651-45bf-8b8a-ac41b939b8f9 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:17.992005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:17.992558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:17.992831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:17.993395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] PATH_INFO: `/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.006753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] RBAC: Authorizing `identity:get_user(user_id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.008172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.009748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 556/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:17 2022] GET /identity/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:18.015625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317df39-087f-476a-9317-23633fb3951c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:18.112206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317df39-087f-476a-9317-23633fb3951c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:18.145592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:18.146168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:18.146469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:18.146733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.171050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:18.213274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.214728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.314643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 559/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:18.320516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:18.381282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:18.417990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed71b7-67bc-48a7-9435-f3a6c59f299d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:18.450794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:18.451409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:18.451681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:18.451947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.453028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.455135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa633-241b-4aea-9a3b-e508f1ac828e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.456994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 557/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:18 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:18.463257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:18.517414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:18.559631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55c2c3-f0e8-4e4a-a877-3b195b531c0c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:18.592272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:18.592868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:18.593146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:18.593416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:18.594131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a, user.id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:18.594467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:18.596374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274a196-55bd-49a1-90be-dbb2184e0395 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:18.601604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 560/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:18 2022] GET /identity/v3/role_assignments?user.id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8&scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:20.451909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d217-3d9a-4cc6-a0da-45f7c43f353c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.452467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d217-3d9a-4cc6-a0da-45f7c43f353c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.452467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d217-3d9a-4cc6-a0da-45f7c43f353c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.453764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 558/1118] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:20.459100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.459515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.459652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.477961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:20.479172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:20.543459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 561/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:20.809179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24d217-3d9a-4cc6-a0da-45f7c43f353c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:20.908130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24d217-3d9a-4cc6-a0da-45f7c43f353c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:20.935982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:20.941063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:20.941674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:20.941950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:20.942240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] PATH_INFO: `/v3/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:20.943584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] RBAC: Authorizing `identity:get_role(role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:20.944929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:20.946232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 559/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:20 2022] GET /identity/v3/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:20.952160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.002835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.051136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08adbd-bb0a-4128-a0cb-821f5c8d259c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.084396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.084959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.085237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.085510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] PATH_INFO: `/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.086639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] RBAC: Authorizing `identity:get_user(user_id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.088061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.089639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 562/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:20 2022] GET /identity/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:21.095465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.192205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43db45-7c31-4636-af77-93b24556a52e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.224608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.225216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.225486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.225749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.226802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.228191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64b045-0696-441c-8d6b-83c4b0e69843 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.229762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 560/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:21 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:21.235731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:21.333103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb002895-a83b-4e87-a092-04144d829a1f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:21.352298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:21.368144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:21.368794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:21.369065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:21.369333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:21.371454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] RBAC: Authorizing `identity:create_grant(project_id=a24f46c3cacb4d8c95b881f8370cc93a, user_id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8, role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:21.372878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73e334-aecb-4d69-a498-f93c56bbecdb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:21.440487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 563/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:21 2022] PUT /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:23.313310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca112-0f1c-4c86-9244-35152fe20786 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.313792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca112-0f1c-4c86-9244-35152fe20786 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.314453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca112-0f1c-4c86-9244-35152fe20786 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.315792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 561/1124] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:23.321060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.321481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.321636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.339389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:23.340550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:23.404655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 564/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:23.679100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca112-0f1c-4c86-9244-35152fe20786 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:23.744944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:23.776740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca112-0f1c-4c86-9244-35152fe20786 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:23.809314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:23.809918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.810211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.810484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] PATH_INFO: `/v3/roles/331e03aa981440f7a4c856b81b3e5c3e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.811837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] RBAC: Authorizing `identity:get_role(role_id=331e03aa981440f7a4c856b81b3e5c3e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:23.813180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:23.814540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 562/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:23 2022] GET /identity/v3/roles/331e03aa981440f7a4c856b81b3e5c3e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:23.820284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:23.916478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4639-d271-47d5-84ac-20ce046e7a0c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:23.927223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:23.950788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:23.951357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:23.951658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:23.951926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] PATH_INFO: `/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:23.953042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] RBAC: Authorizing `identity:get_user(user_id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:23.955106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:23.957236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 565/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:23 2022] GET /identity/v3/users/fe5c2e8a40d1484e8dbb4dcc88b0a7d8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:23.963108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.065104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22310b2-96f9-45ec-9cd0-570c836024c8 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.098158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.098780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.099055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.099325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.102642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:24.163340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.164769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.258513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 563/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:28:24.264421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.374389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6df3e9-d654-45d2-9f17-59eba6f83a5a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.418060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.418714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.418986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.419253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] PATH_INFO: `/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.420362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] RBAC: Authorizing `identity:get_project(project_id=a24f46c3cacb4d8c95b881f8370cc93a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.421776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a916-7c9d-457e-a035-c821eec8b000 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.423472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 566/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:24 2022] GET /identity/v3/projects/a24f46c3cacb4d8c95b881f8370cc93a => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:28:24.429704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:24.463970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:24.525561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954469ae-3af7-492d-ad18-11acc4bcaa21 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:24.557356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:24.557978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:24.558282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:24.558562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:24.559264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] RBAC: Adding query filter params (role.id=331e03aa981440f7a4c856b81b3e5c3e, scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a, user.id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:24.559565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:24.560972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2908a-05fa-412b-9a79-4dce6f0c51e3 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:24.567041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 564/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:24 2022] GET /identity/v3/role_assignments?user.id=fe5c2e8a40d1484e8dbb4dcc88b0a7d8&scope.project.id=a24f46c3cacb4d8c95b881f8370cc93a&role.id=331e03aa981440f7a4c856b81b3e5c3e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:26.452715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eedab-4037-49cd-84ce-c3eab9a969e0 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.453233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eedab-4037-49cd-84ce-c3eab9a969e0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.453233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eedab-4037-49cd-84ce-c3eab9a969e0 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.455217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 567/1131] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:26.460808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.461243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.461348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.479506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:26.480690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:26.546452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 565/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:26.808762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eedab-4037-49cd-84ce-c3eab9a969e0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:26.854837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:26.907295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eedab-4037-49cd-84ce-c3eab9a969e0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:26.940274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:26.940875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:26.941146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:26.941411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:26.942520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:26.943925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878b117-beb4-4d20-a670-20c48ba44bbb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:26.945449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 568/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:26.951314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:26.980042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:27.045893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccbd80-06ad-490d-99e4-6ce6c3aefbde None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:27.082145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:27.083114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:27.083584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:27.084042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:27.085182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:27.087632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245389b-e2b2-4c72-be79-237447e9dc73 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:27.156162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 566/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:26 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:28:29.082124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64438-93cf-4b01-8ded-d50c69cef678 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.093987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64438-93cf-4b01-8ded-d50c69cef678 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.093987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64438-93cf-4b01-8ded-d50c69cef678 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.093987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 569/1135] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:29.094301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.094301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.094301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.108160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:29.109326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:29.172875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 567/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:29.436068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64438-93cf-4b01-8ded-d50c69cef678 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:29.534397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64438-93cf-4b01-8ded-d50c69cef678 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:29.546832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:29.567096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:29.567705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.567978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.568246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.569332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:29.570872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617797-da28-4b8d-8520-cc7cc9309f9e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:29.572390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 570/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:29.577987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:29.592429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:29.673486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ab552-5199-4635-bf43-c896cff040c7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:29.706573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:29.707104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:29.707376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:29.707642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:29.708267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:29.709664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08b023-ab02-4057-9096-d05f89abc232 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:29.794647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 568/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:29 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:31.731389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b84fc-2577-4fd1-beaf-c5274f83ba95 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:31.731894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b84fc-2577-4fd1-beaf-c5274f83ba95 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:31.731894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b84fc-2577-4fd1-beaf-c5274f83ba95 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:31.733189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 571/1139] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:31.738511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:31.738930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:31.739066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:31.757153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:31.758368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:31.817096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:31.822254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 569/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:32.094764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b84fc-2577-4fd1-beaf-c5274f83ba95 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.195043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b84fc-2577-4fd1-beaf-c5274f83ba95 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.228077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.228685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.228959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.229225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.239408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:32.244003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:32.245077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:32.246044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 572/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:32.251171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.360230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a9bc-d247-44c5-ae6b-894f7363ebae None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.393163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.393758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.394035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.394338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.394991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:32.395289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:32.396638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:32.404329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 570/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:32.410209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.460732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.516549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b45e8-f658-4515-acdc-1c31961b5765 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.549787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.550439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.550711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.550977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] PATH_INFO: `/v3/users/aff4a047580f4c8d970311c057eed181` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.563283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] RBAC: Authorizing `identity:get_user(user_id=aff4a047580f4c8d970311c057eed181)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:32.564735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:32.566321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 573/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/users/aff4a047580f4c8d970311c057eed181 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:32.572453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.630023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.669746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d883bc2-be6c-4c3e-a631-6ee9c1e6245c None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:32.701885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:32.702506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:32.702780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:32.703053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:32.771470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:32.772893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:32.827277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.866858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 571/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:32.872829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:32.964825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:32.968367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb278a6-223f-4423-af1a-918c329dd0ef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:33.001608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:33.002237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:33.002514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:33.002781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] PATH_INFO: `/v3/projects/f3582c44dad74d89b325eb51399f86ff` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:33.003861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] RBAC: Authorizing `identity:get_project(project_id=f3582c44dad74d89b325eb51399f86ff)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:33.005292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7752013-a7a7-4415-a2f4-4df4200e09c3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:33.006902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 574/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:32 2022] GET /identity/v3/projects/f3582c44dad74d89b325eb51399f86ff => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:33.012865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:33.107519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21ce86-f726-4cc1-98f2-f79589313882 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:33.139409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:33.139991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:33.140262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:33.140527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:33.141227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=f3582c44dad74d89b325eb51399f86ff, user.id=aff4a047580f4c8d970311c057eed181) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:33.141539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:33.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fb2cf-73fd-434a-bf5b-9f6572b46848 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:33.148558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 572/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:33 2022] GET /identity/v3/role_assignments?user.id=aff4a047580f4c8d970311c057eed181&scope.project.id=f3582c44dad74d89b325eb51399f86ff&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.005733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b9b3-c485-47ff-a5d3-bce7e1204060 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.006274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b9b3-c485-47ff-a5d3-bce7e1204060 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.006367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8b9b3-c485-47ff-a5d3-bce7e1204060 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.007643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 575/1147] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:35.013130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.013532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.013647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.031636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:35.032836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:35.049351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.098164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 573/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:35.363044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8b9b3-c485-47ff-a5d3-bce7e1204060 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.461097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8b9b3-c485-47ff-a5d3-bce7e1204060 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.493448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.494053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.494472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.494746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.504914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:35.509510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:35.510634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:35.511719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 576/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:35.516536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.611672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b167ece-a522-46fc-bebb-ebeb34ee8245 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.644597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.645189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.645465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.645738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.646415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:35.646715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.648064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:35.655776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 574/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.661556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.688421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.758590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd9f0f-9b28-40e3-9a17-f8129707bed0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.791135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.791748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.792023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.792288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] PATH_INFO: `/v3/users/aff4a047580f4c8d970311c057eed181` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.793387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] RBAC: Authorizing `identity:get_user(user_id=aff4a047580f4c8d970311c057eed181)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.794846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:35.796402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 577/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/users/aff4a047580f4c8d970311c057eed181 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.802168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:35.820619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:35.899602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebb1c6-8a17-45da-98fb-e0cfb7af66e2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:35.932582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:35.933192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:35.933466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:35.933737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] PATH_INFO: `/v3/projects/f3582c44dad74d89b325eb51399f86ff` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:35.934854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] RBAC: Authorizing `identity:get_project(project_id=f3582c44dad74d89b325eb51399f86ff)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:35.936256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a45e4-b13d-4c6e-ba2d-06c29b2fb645 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:35.937838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 575/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:35 2022] GET /identity/v3/projects/f3582c44dad74d89b325eb51399f86ff => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:35.944168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:36.038222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:36.044809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5555e-3b99-4663-bd7f-331764a84407 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:36.078856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:36.079503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:36.079783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:36.080047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] PATH_INFO: `/v3/projects/f3582c44dad74d89b325eb51399f86ff/users/aff4a047580f4c8d970311c057eed181/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:36.082169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] RBAC: Authorizing `identity:create_grant(project_id=f3582c44dad74d89b325eb51399f86ff, user_id=aff4a047580f4c8d970311c057eed181, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:36.083608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5cb20-bf7f-475d-a37a-1fc6e5778fde None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:36.158260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 578/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:35 2022] PUT /identity/v3/projects/f3582c44dad74d89b325eb51399f86ff/users/aff4a047580f4c8d970311c057eed181/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:38.019441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fa83-65c0-4251-aae3-c56ec157aff4 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.019963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fa83-65c0-4251-aae3-c56ec157aff4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.019963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fa83-65c0-4251-aae3-c56ec157aff4 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.021282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 576/1154] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:38.026432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.026860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.026989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.046468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:38.047655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:38.113304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 579/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:38.379447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108fa83-65c0-4251-aae3-c56ec157aff4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.462500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:38.488199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108fa83-65c0-4251-aae3-c56ec157aff4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.521119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.521732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.522008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.522303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.531977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:38.537121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:38.538333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:38.539416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 577/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:38.544375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.625049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:38.640198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d29da2-8196-4e26-aa4b-1680ffc7c696 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.673926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.676059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.676059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.676059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.676059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:38.676059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:38.677374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:38.685179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 580/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:38.690938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.786494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4d83-ec9b-4e59-81e7-cd8b0eefe9be None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.818910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.819459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.819734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.820005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] PATH_INFO: `/v3/users/aff4a047580f4c8d970311c057eed181` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.821101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] RBAC: Authorizing `identity:get_user(user_id=aff4a047580f4c8d970311c057eed181)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:38.822534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:38.824061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 578/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/users/aff4a047580f4c8d970311c057eed181 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:38.830023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:38.927197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df68-3953-4cb9-bfd3-e00cdc3c47f4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:38.959662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:38.960244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:38.960516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:38.960782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:38.976853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:39.026728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:39.028148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:39.124158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 581/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:39.130068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:39.145640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:39.227148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5c17d-0881-431a-987f-db4a60c608b5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:39.259651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:39.260264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:39.260539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:39.260809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] PATH_INFO: `/v3/projects/f3582c44dad74d89b325eb51399f86ff` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:39.261921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] RBAC: Authorizing `identity:get_project(project_id=f3582c44dad74d89b325eb51399f86ff)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:39.263380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d38fc-ea93-4180-aebe-94b3dda3735a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:39.264997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 579/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:39 2022] GET /identity/v3/projects/f3582c44dad74d89b325eb51399f86ff => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:39.271664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:39.316500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:39.367977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489e27a-75f6-40ba-906f-c992d102b8ef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:39.401138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:39.401672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:39.401946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:39.402237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:39.402947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=f3582c44dad74d89b325eb51399f86ff, user.id=aff4a047580f4c8d970311c057eed181) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:39.403247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:39.404657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96beb2fb-45d3-46f6-99b3-09982c7e0a6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:39.410236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 582/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:39 2022] GET /identity/v3/role_assignments?user.id=aff4a047580f4c8d970311c057eed181&scope.project.id=f3582c44dad74d89b325eb51399f86ff&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:41.327376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf15f-add0-44fa-a99b-178b1d25dcb9 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.327800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf15f-add0-44fa-a99b-178b1d25dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.327914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bf15f-add0-44fa-a99b-178b1d25dcb9 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.329248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 580/1162] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:41.335157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.335575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.335702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.353874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:41.355094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:41.420327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 583/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:41.686653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bf15f-add0-44fa-a99b-178b1d25dcb9 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:41.765199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:41.784786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bf15f-add0-44fa-a99b-178b1d25dcb9 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:41.817699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:41.818313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:41.818591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:41.818863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:41.882862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:41.884284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:41.960198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:41.978524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 581/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:41.984365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:42.024691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:42.080211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc3d66-3496-479f-b15a-0002c41e4a82 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.113244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.113867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.114152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.114443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.120941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.122488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f3fd52ca-6dfb-4d36-8ac6-5620eef2f0eb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:42.134096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:42.135295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:42.136197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 584/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:28:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:42.142649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:42.239502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e560565-3629-473e-a56a-62d4e022cf92 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:42.272917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:42.273516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:42.273793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:42.274061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:42.274723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:42.275020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:42.276362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cde84-ecf8-4a0c-8cce-21bd2d4fc681 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:42.283521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 582/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Mon Aug 22 12:28:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:44.146524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f61c0-66f4-4c6e-a970-cf410b465b6d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:44.147082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f61c0-66f4-4c6e-a970-cf410b465b6d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:44.147082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f61c0-66f4-4c6e-a970-cf410b465b6d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:44.148478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 585/1167] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:44.153624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930be7a-b31f-4100-b169-2dad05776685 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:44.154058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930be7a-b31f-4100-b169-2dad05776685 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:44.154160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930be7a-b31f-4100-b169-2dad05776685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:44.172210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2930be7a-b31f-4100-b169-2dad05776685 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:44.173907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2930be7a-b31f-4100-b169-2dad05776685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:44.212723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:44.239020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 583/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:44.507522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f61c0-66f4-4c6e-a970-cf410b465b6d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:44.605885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:44.609464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f61c0-66f4-4c6e-a970-cf410b465b6d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:44.642659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:44.643254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:44.643530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:44.643799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:44.644442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:44.645787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222accd-54ab-436b-bab1-398d9db3c85b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:44.708683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 586/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Mon Aug 22 12:28:44 2022] POST /identity/v3/domains => generated 267 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:46.633355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496949b-ac27-4523-bf35-150900bfb7df None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:46.633872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496949b-ac27-4523-bf35-150900bfb7df None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:46.633872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496949b-ac27-4523-bf35-150900bfb7df None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:46.635216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 584/1170] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:46.640533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca267-b151-4320-8351-488e8456037c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:46.640946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca267-b151-4320-8351-488e8456037c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:46.641077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca267-b151-4320-8351-488e8456037c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:46.659863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-63eca267-b151-4320-8351-488e8456037c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:46.661043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-63eca267-b151-4320-8351-488e8456037c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:46.725568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 587/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:46.998326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496949b-ac27-4523-bf35-150900bfb7df None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:47.094727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496949b-ac27-4523-bf35-150900bfb7df None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:47.127610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:47.128218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:47.128488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:47.128757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] PATH_INFO: `/v3/domains/21f62f4eaf5446e19b3f5286783f1211` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:47.138703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=21f62f4eaf5446e19b3f5286783f1211)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:47.140130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611fd27-7cd1-4f0c-a1b9-c1f657df6ec2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:47.141676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 585/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Mon Aug 22 12:28:46 2022] GET /identity/v3/domains/21f62f4eaf5446e19b3f5286783f1211 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:47.147979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eca267-b151-4320-8351-488e8456037c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:47.244964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:47.254384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eca267-b151-4320-8351-488e8456037c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:47.288819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:47.289419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:47.289693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:47.289958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:47.290619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:47.292142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fc69e-567e-4e74-b7d9-f10495ae3dff None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:47.370761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 588/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:28:47 2022] POST /identity/v3/projects => generated 361 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:49.281116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c96b-a275-46e1-bc0d-6edd73bba767 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.281652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c96b-a275-46e1-bc0d-6edd73bba767 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.281652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1c96b-a275-46e1-bc0d-6edd73bba767 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.283054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 586/1174] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:49.288347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.288726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.288894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.306844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:49.308031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:49.384729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 589/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:49.655111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c96b-a275-46e1-bc0d-6edd73bba767 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:49.690466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:49.754652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1c96b-a275-46e1-bc0d-6edd73bba767 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:49.787221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:49.787836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.788112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.788385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] PATH_INFO: `/v3/domains/21f62f4eaf5446e19b3f5286783f1211` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.789479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=21f62f4eaf5446e19b3f5286783f1211)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:49.790915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187ca4e-337c-44c0-be51-27ac574ce08f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:49.792441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 587/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Mon Aug 22 12:28:49 2022] GET /identity/v3/domains/21f62f4eaf5446e19b3f5286783f1211 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:49.798151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:49.864470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:49.892358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33332ef6-1484-4eb3-93ec-ea79cd4b0268 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:49.925398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:49.926164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:49.926648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:49.926964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:49.927998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:49.929426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9139e19-9d32-4c96-a4b5-bfea9d82b1cf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:50.034657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 590/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:28:49 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:28:51.974807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e0f0-663f-4a84-ac1a-101b81a2fe0b None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:51.975367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e0f0-663f-4a84-ac1a-101b81a2fe0b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:51.975367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1e0f0-663f-4a84-ac1a-101b81a2fe0b None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:51.976659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 588/1178] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:51.981891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:51.982324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:51.982474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.000634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:52.001843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:52.066490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 591/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:52.329585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1e0f0-663f-4a84-ac1a-101b81a2fe0b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:52.427016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1e0f0-663f-4a84-ac1a-101b81a2fe0b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:52.428497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:52.460726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:52.461334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.461607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.461871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.472018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:52.476599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:52.477827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:52.478934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 589/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:52.483801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:52.544784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:52.587098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59615b76-fcd6-4ad6-9d5c-716417635d48 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:52.620614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:52.621215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.621494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.621766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.622448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:52.622753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:52.624117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:52.632510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 592/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:52.638422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:52.742086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea99f-3cd1-4259-a19c-3d8255c10ec0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:52.775089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:52.775696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.775970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.776236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] PATH_INFO: `/v3/users/907b21bd2b0f4aa0b54b5af111227120` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:52.788823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] RBAC: Authorizing `identity:get_user(user_id=907b21bd2b0f4aa0b54b5af111227120)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:52.790279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:52.791851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 590/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:52 2022] GET /identity/v3/users/907b21bd2b0f4aa0b54b5af111227120 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:52.797858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:52.906472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e39b-4c44-48ae-8444-b42532fa918d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:52.926379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:52.942683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:52.943288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:52.943568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:52.943840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:53.018298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:53.019758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:53.131668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 593/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:53.137627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:53.161257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:53.237200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504150c9-16e5-4103-aed2-1e441729cdef None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:53.270863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:53.271490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:53.271769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:53.272042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] PATH_INFO: `/v3/projects/d7f9280437c7479484eec0587bf1ee92` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:53.273153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] RBAC: Authorizing `identity:get_project(project_id=d7f9280437c7479484eec0587bf1ee92)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:53.274611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c39fd-b005-4d8f-9658-2ffea0b86d6a None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:53.276258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 591/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:53 2022] GET /identity/v3/projects/d7f9280437c7479484eec0587bf1ee92 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:53.283090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:53.303992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:53.383274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd5754-881c-45c7-b88c-2c095cebca84 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:53.415960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:53.416551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:53.416821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:53.417087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:53.417788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=d7f9280437c7479484eec0587bf1ee92, user.id=907b21bd2b0f4aa0b54b5af111227120) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:53.418087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:53.419524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f97f4-5045-4b5a-82ee-bc046fe34eab None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:53.425369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 594/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:53 2022] GET /identity/v3/role_assignments?user.id=907b21bd2b0f4aa0b54b5af111227120&scope.project.id=d7f9280437c7479484eec0587bf1ee92&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:55.277427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a111c-6c37-496c-842b-75e766b668be None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.277941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a111c-6c37-496c-842b-75e766b668be None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.278052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a111c-6c37-496c-842b-75e766b668be None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.279337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 592/1186] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:55.284365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.284753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.284925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.302454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:55.303634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:55.380362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 595/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:55.642943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a111c-6c37-496c-842b-75e766b668be None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:55.728882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:55.741427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a111c-6c37-496c-842b-75e766b668be None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:55.773373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:55.773974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.774274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.774541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.784761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:55.789350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:55.790455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:28:55.791303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 593/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:55.796361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:55.811460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:55.891843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dbb88-9bf9-4590-b670-d5ca0a7f20cb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:55.924608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:55.925137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:55.925409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:55.925673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:55.926342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:55.926637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:55.927974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:55.935631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 596/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:55.941229 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.036781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113bbe3-3dd0-4bde-900f-fd25108a6aeb None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.069776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.070406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.070678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.070942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] PATH_INFO: `/v3/users/907b21bd2b0f4aa0b54b5af111227120` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.072029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] RBAC: Authorizing `identity:get_user(user_id=907b21bd2b0f4aa0b54b5af111227120)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.073426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.074978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 594/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:55 2022] GET /identity/v3/users/907b21bd2b0f4aa0b54b5af111227120 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:56.081020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.154965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:56.177042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a6797-5ca2-4932-ad90-bf7142551e6d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.210676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.211287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.211559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.211822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] PATH_INFO: `/v3/projects/d7f9280437c7479484eec0587bf1ee92` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.212898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] RBAC: Authorizing `identity:get_project(project_id=d7f9280437c7479484eec0587bf1ee92)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.214325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dcdcb-3f5f-4bf0-8175-a1ff39183e30 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.215906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 597/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:56 2022] GET /identity/v3/projects/d7f9280437c7479484eec0587bf1ee92 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:56.221708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:56.240580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:56.319703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09f950-80e7-41c1-ad34-511239d46902 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:56.352332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:56.352980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:56.353255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:56.353526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] PATH_INFO: `/v3/projects/d7f9280437c7479484eec0587bf1ee92/users/907b21bd2b0f4aa0b54b5af111227120/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:56.355437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] RBAC: Authorizing `identity:create_grant(project_id=d7f9280437c7479484eec0587bf1ee92, user_id=907b21bd2b0f4aa0b54b5af111227120, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:56.356853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ce9c-dfe6-4012-8791-2fe920841afb None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:56.423804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 595/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:28:56 2022] PUT /identity/v3/projects/d7f9280437c7479484eec0587bf1ee92/users/907b21bd2b0f4aa0b54b5af111227120/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:28:58.282447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737efd-160c-4251-9e8d-5b110fe78114 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.282964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737efd-160c-4251-9e8d-5b110fe78114 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.282964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27737efd-160c-4251-9e8d-5b110fe78114 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.284328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 598/1193] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:28:58.289785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.290236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.290412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.307943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:28:58.309112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:28:58.389708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 596/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:28:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:28:58.656156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27737efd-160c-4251-9e8d-5b110fe78114 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:58.755451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27737efd-160c-4251-9e8d-5b110fe78114 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:58.787954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:58.788816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.789092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.789363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.800275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:28:58.804925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:28:58.806031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:28:58.806916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 599/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:28:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:28:58.812111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:58.820264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:58.906087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e172cf-2592-4c36-b912-27689cb6351f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:58.944839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:58.945365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:58.945644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:58.945914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:58.946592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:58.946889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:58.948242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:58.957217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 597/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:58.962983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:58.966720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.060167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef47947-489b-45b2-8a8f-6c2b796012aa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.093160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.093771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.094045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.094341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] PATH_INFO: `/v3/users/907b21bd2b0f4aa0b54b5af111227120` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.095466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] RBAC: Authorizing `identity:get_user(user_id=907b21bd2b0f4aa0b54b5af111227120)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.096869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.098445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 600/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Mon Aug 22 12:28:58 2022] GET /identity/v3/users/907b21bd2b0f4aa0b54b5af111227120 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:59.104393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.168547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.201365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc55f-a4cc-4cf0-a014-84142f8123c5 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.233397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.233988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.234288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.234563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.299853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.301281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.362790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.396091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 598/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:28:59.401964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.471297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:28:59.499008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c66b-2f96-4293-9abd-6dbf58f19751 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.532163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.532804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.533080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.533350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] PATH_INFO: `/v3/projects/d7f9280437c7479484eec0587bf1ee92` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.534462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d7f9280437c7479484eec0587bf1ee92)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.535884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10f2df-0b7e-4121-8de0-255f52ba39c2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.537488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 601/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/projects/d7f9280437c7479484eec0587bf1ee92 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:28:59.543494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:28:59.639552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3b263-3c42-4c1f-a1fa-2e1bfcfd6c2b None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:28:59.671486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:28:59.672069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:28:59.672341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:28:59.672606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:28:59.673300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=d7f9280437c7479484eec0587bf1ee92, user.id=907b21bd2b0f4aa0b54b5af111227120) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:28:59.673598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:28:59.675019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fa361-c851-48fd-ba5a-1c8d98e04a37 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:28:59.680472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 599/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:28:59 2022] GET /identity/v3/role_assignments?user.id=907b21bd2b0f4aa0b54b5af111227120&scope.project.id=d7f9280437c7479484eec0587bf1ee92&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:29:09.528119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=30 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:29:09.678149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:16.849307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7210f-5009-4ed1-9dd2-876299d78852 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:16.849929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7210f-5009-4ed1-9dd2-876299d78852 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:16.849929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7210f-5009-4ed1-9dd2-876299d78852 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:16.851306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 602/1201] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:16.856666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:16.857054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:16.857207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:16.874936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:16.876103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:16.942959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 600/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:17.213892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7210f-5009-4ed1-9dd2-876299d78852 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:17.316014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7210f-5009-4ed1-9dd2-876299d78852 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:17.349216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:17.350759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:17.350759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:17.350759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:17.361374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:17.362872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:17.377213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:17.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:17.381391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:17.381391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:17.381391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:17.381391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 603/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:17.384589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:17.479855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913f6bd-5541-4d44-88bd-aa035c78324f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:17.507139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:17.512747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:17.513343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:17.513614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:17.513880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:17.514529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:17.514842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:17.516160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c1e0e-4c1b-4b28-9993-e6d5286ffe05 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:17.526867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 601/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:17.533046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:17.586008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:17.632751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0856-b21f-4903-9e01-10f94e2074ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:17.665871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:17.666539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:17.666824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:17.667094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:17.667724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:17.669151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf8e03-9fd6-4ddd-af5d-07417afae04e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:17.765306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 604/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Mon Aug 22 12:30:17 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:30:19.681041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f8d8-48ef-43ae-b8b6-cde7bf976177 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:19.681552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f8d8-48ef-43ae-b8b6-cde7bf976177 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:19.681552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f8d8-48ef-43ae-b8b6-cde7bf976177 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:19.682847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 602/1206] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:19.688138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:19.688566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:19.688670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:19.712420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:19.713604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:19.778666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 605/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:20.053091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24f8d8-48ef-43ae-b8b6-cde7bf976177 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.154582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24f8d8-48ef-43ae-b8b6-cde7bf976177 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.187363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.187976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.188249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.188515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.198401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:20.203090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:20.204251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:20.205469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 603/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:20.210489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.249785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:20.308259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3f674-17e7-40ef-8a2a-c09c68e303bc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.343062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.343665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.343942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.344209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.344859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:20.345154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:20.346749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:20.355049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 606/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:20.361031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.410809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:20.458354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda9934-071f-40b6-9f91-8aa5054e30f9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.490293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.490902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.491174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.491437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.501674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:20.503114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:20.516949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:20.517942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:20.519240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:20.519240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:20.519240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:20.519240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 604/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:20.524057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.620650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:20.623515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654ea2-1210-4e55-abc0-bd3a13012fa4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.656034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.657479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.657479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.657479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.657750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:20.658013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:20.659383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:20.670581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 607/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:20.676345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.775594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6e003-2711-4d11-a228-83700ca18f92 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.777117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:20.809489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.810124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.810411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.810679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.817527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:20.819004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:20.831064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:20.832285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:20.833265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 605/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:20.838385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:20.935745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5c199-ff9f-49fb-bffb-6b0f5b9e421b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:20.969065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:20.969655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:20.969930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:20.970237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:20.970917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:20.971212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:20.972636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:20.989001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 608/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:20.995277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:21.093289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575286da-a59c-44d3-9180-1874793ebc33 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:21.135300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:21.135898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.136164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.136430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.165787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.208301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:21.209924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:21.311337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 606/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:21.317264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:21.339096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.421890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3bd4f-8ca8-4a4d-99e3-5da920909244 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:21.465162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:21.465747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.466021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.466363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.476719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:21.478154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:21.492225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:21.493713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:21.499468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:21.499468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:21.499468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:21.499468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 609/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:21.499716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:21.572800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.616137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e966bf2-7f99-4dff-bd23-e29e991818bf None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:21.654206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:21.654824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.655127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.655485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.656119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:21.656411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:21.657815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:21.671094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 607/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:21.676910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:21.751269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.782605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a8ca-2baf-4f1b-bec4-d4f9b4b16484 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:21.816274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:21.816896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.817171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.817437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.823934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:21.825363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:21.836455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:21.843129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:21.844247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 610/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:21.844935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:21.942161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ed9fc-acac-4c9c-8dc6-638b6f06cf10 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:21.970045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:21.982991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:21.983603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:21.983886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:21.984159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:21.984846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:21.985146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:21.986666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9eb-0bb2-489f-bec6-8bf2159368a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:21.998651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 608/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:22.005066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:22.107335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2dc8-caa7-4f4c-819b-07e3d56ddbdc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:22.135427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:22.141202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:22.141799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:22.142069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:22.142370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:22.143075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f2887cf82974425388d18660bf964fa9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:22.143373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:22.144793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b9250-12d2-408c-805b-15c69c55e569 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:22.150751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 611/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:22 2022] GET /identity/v3/role_assignments?user.id=f2887cf82974425388d18660bf964fa9&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:24.026767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ccda-40e9-4f2a-a691-7d09bcda1b7e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.027311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ccda-40e9-4f2a-a691-7d09bcda1b7e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.027311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7ccda-40e9-4f2a-a691-7d09bcda1b7e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.028669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 609/1220] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:24.034085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.034566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.034656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.052813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:24.053992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:24.120194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 612/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:24.389295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ccda-40e9-4f2a-a691-7d09bcda1b7e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:24.497699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7ccda-40e9-4f2a-a691-7d09bcda1b7e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:24.530484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:24.531100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.531378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.531740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.542016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:24.546674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:24.553522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:24.554514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 610/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:24.555217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:24.653388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6640c45-cd4e-40a5-95d8-7249261f2335 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:24.676732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:24.687930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:24.688532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.688809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.689080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.689728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:24.690026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:24.691455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:24.699812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 613/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:24.706098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:24.749672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:24.805316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e5fb-a804-4d91-95e4-bb155d221764 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:24.838397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:24.842034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:24.842034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:24.842034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:24.849967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:24.851441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:24.866100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:24.867252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:24.868709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:24.868709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:24.868709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:24.868709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 611/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:24.873741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:24.971674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28df221-953e-4dc0-8232-a565cdefbef9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.005423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.006029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.006354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.006627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.007261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.007562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.008964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.020589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 614/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.026406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.124212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.130540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc093073-8a49-4c2f-adfa-a92228d24f53 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.163261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.164006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.164281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.164546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.171784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.173196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:25.184777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.185911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:25.187179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 612/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.191752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.239439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.296920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27365c8-8bbc-4af6-a730-a5a01a7a76ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.329651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.330344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.330626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.330897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.331622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.331925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.333345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.350428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 615/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.356799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.454894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4846664-d3db-4f6d-a4f4-2fd53df4f79e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.488625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.489245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.489520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.489786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.500087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.501519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:25.515899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.517051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:25.517961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:25.517961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:25.517961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:25.517961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 613/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.523008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.622243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71599ea-fc18-45ff-a00e-8fcffde36b7f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.624737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.656364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.656955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.657228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.657512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.658129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.658453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.659791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.670684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 616/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:25.676344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.685576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:25.774785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac369d2-059f-4bd0-9c7f-9c57f140376f None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.807289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.807911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.808188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.808459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.815096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.816534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:25.828083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:25.829145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:25.839261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 614/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:25.839758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:25.935765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5978d4-dcf3-4475-a370-2c0cfcf79667 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:25.973293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:25.974165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:25.974472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:25.974821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:25.975499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:25.975799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:25.977242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a3a00-85f3-4446-bc2b-82f7d10314dd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:25.989185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 617/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:25.995908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:26.061588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:26.096025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807150f-203c-458b-92cf-3f1186369cad None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:26.128386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:26.129062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:26.129308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:26.129578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f2887cf82974425388d18660bf964fa9/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:26.144268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=f2887cf82974425388d18660bf964fa9, role_id=8d8ee35c0e3e4fe48ad5bb61a9efb605)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:26.145689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0c40c-221c-4548-9f3f-bd9713cc28a5 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:26.256027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 615/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:30:25 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f2887cf82974425388d18660bf964fa9/roles/8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:30:28.145919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25fb7-1919-4a16-9589-4f1f3c9182b1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.146606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25fb7-1919-4a16-9589-4f1f3c9182b1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.146606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e25fb7-1919-4a16-9589-4f1f3c9182b1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.147904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 618/1233] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:28.153844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.154287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.154405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.173246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:28.174451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:28.239406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 616/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:28.503653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e25fb7-1919-4a16-9589-4f1f3c9182b1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:28.529966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:28.604702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e25fb7-1919-4a16-9589-4f1f3c9182b1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:28.639211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:28.639838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.640116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.640390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.650898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:28.655664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:28.656762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:28.657717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 619/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Mon Aug 22 12:30:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:28.663035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:28.708777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:28.761305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eeae8-dd53-4b60-93da-68c7c655e902 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:28.794323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:28.796445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.796445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.796445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.796445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:28.796445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:28.797703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:28.805435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 617/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Mon Aug 22 12:30:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:28.811297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:28.895359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:28.910933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c01d5-4066-40d9-909c-96b8c9e05403 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:28.944981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:28.945602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:28.946484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:28.946766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:28.956342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:28.959209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:28.972035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:28.973150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:28.974431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:28.974431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:28.974431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:28.974431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 620/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:28.979245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.078126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c970a09-8be6-445a-8457-a1c681875b52 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.086991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.111098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.111704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.111995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.112254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.112880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:29.113178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.114559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.130277 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 618/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:29.136700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.236469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533be21-a1bf-4d58-b0e5-f9af988e612a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.275765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.276391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.276661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.276923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.279558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.284755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.289465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:29.301792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:29.302995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:29.304178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 621/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:29.306648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.404239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8726f-7408-45e0-bcdc-e903299ba0a9 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.439946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.440545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.440816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.441081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.441789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:29.442083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.443517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.461087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 619/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:29.467033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.566911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b27db-1cc4-402f-9b4b-2ffb3fe11913 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.600149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.600742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.601021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.601293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.661658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.668748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.670202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.763993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 622/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:29.769874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:29.797835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:29.867037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92df6-cb9e-4763-959c-0bf6c223001e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:29.899641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:29.900788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:29.901065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:29.901333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:29.910882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:29.919937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:29.926658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:29.927769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:29.928839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:29.928839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:29.928839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:29.928839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 620/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:29.933540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.033741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbc58b-f8b6-4462-8ebc-b015d4618e6b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.045498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.067751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.068342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.068622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.068900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.069528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.069827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.071211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.082716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 623/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:30.089268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.168158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:30.189077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613171-7e3c-49dc-bfd0-13a51e128356 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.222800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.223421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.223707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.223972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.230694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.232201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:30.243096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:30.246696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:30.247833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 621/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:30.250267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.351725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d63f-3d86-4cbd-8321-aaa68f577260 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.385160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.385762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.386044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.386348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.387027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.391585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.391585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782f4a3-7d0e-429a-9386-3bff339a4e76 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.400433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 624/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:30.406608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:30.504048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f9c5-f18b-4132-bf5d-f0aefe814111 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:30.536647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:30.537233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:30.537514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:30.537782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:30.538533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] RBAC: Adding query filter params (role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f2887cf82974425388d18660bf964fa9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:30.538838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:30.540251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7d035-5303-49d2-b24d-7e294c80a2ba None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:30.545813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 622/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:30 2022] GET /identity/v3/role_assignments?user.id=f2887cf82974425388d18660bf964fa9&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=8d8ee35c0e3e4fe48ad5bb61a9efb605 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:32.499552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc050-c4d0-4060-bde3-12a96f528a03 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:32.500065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc050-c4d0-4060-bde3-12a96f528a03 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:32.500065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc050-c4d0-4060-bde3-12a96f528a03 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:32.501457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 625/1247] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:32.506652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:32.507059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:32.507220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:32.513580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:32.525341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:32.526545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:32.591471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 623/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:32.860324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc050-c4d0-4060-bde3-12a96f528a03 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:32.878752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:32.961204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc050-c4d0-4060-bde3-12a96f528a03 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:32.995748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:32.996375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:32.996652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:32.996920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.006898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:33.011723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:33.012964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:33.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 626/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:33.018883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.116142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838fb20-0fd2-4787-93b0-1381cf863e3e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.144640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.149516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.150132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.150438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.150705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.151373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:33.151668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.153065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.160803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 624/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:33.167184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.245017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.267877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd631f6-5626-4b8c-8135-3885533d7975 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.300435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.301051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.301327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.301596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.314014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.315521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:33.329631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:33.330876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:33.332037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:33.332037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:33.332037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:33.332037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 627/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:30:33.337225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.436648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53345038-c361-4b64-ad97-e82b8a05de98 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.469764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.470383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.470662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.470935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.471555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:33.471931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.473308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.485682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 625/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:33.491576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.593499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea55f-790c-4175-b509-00957e6b2357 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.619307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.626939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.627555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.627828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.628092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.635270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.636691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:33.647343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:33.648489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:33.650215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 628/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:33.654927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.708394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:33.751741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25f41-b9c1-4eef-be85-e99b59ef3c70 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.784616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.785231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.785476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.785745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:33.786592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:33.786888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:33.788295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:33.805200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 626/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:33.811114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:33.910038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce833f-9a32-42c7-af3b-53a8adc34cef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:33.944193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:33.944794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:33.945064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:33.945330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.000234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.012649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.014103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.111736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 629/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 12:30:34.117626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.215101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5d1c-e572-405d-8d9b-8c6ac66a48b7 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.228681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.249586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.250224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.250549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.250771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.261599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.263096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:34.277414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:34.278640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:34.279618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:34.279618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:34.279618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:34.279618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 627/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:34.284312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.373794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.386020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4d42-d665-4618-ac46-3c5147b11208 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.419561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.420164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.420443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.420708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.421343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:34.421643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.423035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.434089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 630/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:34.439887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.538501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f433e79-d594-470b-80a3-10adcca8a489 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.569916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.570557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.570830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.571095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.577981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.579429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:34.591234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:34.592386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:34.593266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 628/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:34.598666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.696908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c624f-9b15-4dd1-919e-b746d4043a2c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.730227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.730837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.731114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.731386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.732068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:34.732372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.733795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a38173-b46f-49e8-b8c2-7ed989ae4022 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.746351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 631/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:34.752609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:34.777270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:34.857446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75df517-2ddb-4d5e-9a4f-4b196bae8a18 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:34.891305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:34.891887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:34.892163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:34.892426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:34.893125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f2887cf82974425388d18660bf964fa9) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:34.893423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:34.894865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424af87-597d-4c74-97d7-6a9bc5f9e2ef None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:34.900544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 629/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:34 2022] GET /identity/v3/role_assignments?user.id=f2887cf82974425388d18660bf964fa9&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:36.761807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe9c1-b2ee-4395-9a3f-bc28ce3dfc74 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:36.762364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe9c1-b2ee-4395-9a3f-bc28ce3dfc74 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:36.762364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe9c1-b2ee-4395-9a3f-bc28ce3dfc74 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:36.763627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 632/1261] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:36.768614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:36.768993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:36.769149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:36.787083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:36.788246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:36.855399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 630/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:37.120786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe9c1-b2ee-4395-9a3f-bc28ce3dfc74 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.131858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.222926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe9c1-b2ee-4395-9a3f-bc28ce3dfc74 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.256504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.257122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.257394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.257659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.268498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:37.273164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:37.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:37.275705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 633/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:37.280220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.297868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.384806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0077-6a1f-4205-a3d7-ed8506ccf499 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.419707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.420316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.420674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.420954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.421614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:37.421913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:37.423328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:37.432003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 631/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:37.437745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.505719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.536799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463cec-5594-429d-9135-9db516a4bd32 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.569378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.569991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.570303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.570572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.580137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:37.581550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:37.595797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:37.596916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:37.598051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:37.598051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:37.598051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:37.598051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 634/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:37.604850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.684600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.702725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a52b5-6503-44e1-9ca0-9849560e5547 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.738888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.739492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.739772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.740045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.740676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:37.740977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:37.742359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:37.753695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 632/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:37.759474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:37.860946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9e14d-199f-47d7-9e3f-6f75ba253b77 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:37.880891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:37.894444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:37.895069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:37.895344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:37.895616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:37.903455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:37.904882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:37.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:37.921952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:37.923249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 635/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:37.924083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.020132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740eaf2-a1b8-48fe-827a-529f8d8ed34d None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.053486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.054085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.054390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.054660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.055375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.055676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.057215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.065924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.073700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 633/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.079618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.177884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6b88-cabc-47ec-b31f-9ef2780322d7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.209972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.210623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.210897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.211166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.222475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.223916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:38.238313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:38.239418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:38.240697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:38.240697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:38.240697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:38.240697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 636/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:38.245286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.344583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a2299-dc0c-4e44-b82e-b8ee21c900d2 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.377683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.378320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.378603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.378874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.379505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.379805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.381218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.392617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 634/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.398672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.430927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.497825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934fb21-4350-4947-be7b-0ebb81d5c085 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.531794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.532417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.532696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.532968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.539505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.540926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:38.551898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:38.552769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:38.553841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 637/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:38.558922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.616251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.657137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69993ef-048e-4216-a64b-b55384567b6e None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.689370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.689960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.690265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.690538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.691210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:38.691507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.692916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda249-8dcf-4b5d-8d5c-d6af4807c761 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.704861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 635/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:38.711240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:38.802258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:38.811448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1b3e-e6ac-4a9b-ac32-69865b76e541 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:38.844478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:38.845135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:38.845408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:38.845676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] PATH_INFO: `/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f2887cf82974425388d18660bf964fa9/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:38.847625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] RBAC: Authorizing `identity:create_grant(project_id=93dc7b26e6af4baba62dc8470e2fd706, user_id=f2887cf82974425388d18660bf964fa9, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:38.849059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20d8f9-38c8-4f5d-832b-6cc713d594eb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:38.924069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 638/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Mon Aug 22 12:30:38 2022] PUT /identity/v3/projects/93dc7b26e6af4baba62dc8470e2fd706/users/f2887cf82974425388d18660bf964fa9/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:30:40.814081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f591-7bb7-42bc-908d-f6eb999601b1 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:40.814626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f591-7bb7-42bc-908d-f6eb999601b1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:40.814738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672f591-7bb7-42bc-908d-f6eb999601b1 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:40.816011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 636/1274] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:40.822071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:40.822621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:40.822899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:40.840916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:40.842098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:40.909290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 639/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 12:30:41.177214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f591-7bb7-42bc-908d-f6eb999601b1 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.276929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672f591-7bb7-42bc-908d-f6eb999601b1 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:41.295127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:41.311783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:41.312392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.312664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.312929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.322868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 12:30:41.327861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:41.332039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:41.333078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 637/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:41.335385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.423682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:41.441243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca63f23-ec0b-4352-9fa8-44c2ef194476 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:41.474892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:41.475496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.475778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.476051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.476706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:41.477008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:41.478398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:41.486239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 640/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:41.492065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.591267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91efa8d-89e5-49b1-912d-e01c7e077832 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:41.625054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:41.625671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.626018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.626325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.636876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:41.638333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:41.652502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:41.653625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:41.654954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:41.654954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:41.654954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:41.654954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 638/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:30:41.659650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.758401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b027f-c6c4-4c85-b84f-3a4afb2c333b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:41.791782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:41.792380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.792658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.792930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.793556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:41.793856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:41.795249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:41.807257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 641/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:41.813000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.845443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:41.914791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259147-dd93-4084-a609-9f0b11303225 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:41.948251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:41.948872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:41.949147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:41.949415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:41.956402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:41.957820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 12:30:41.969282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:41.976113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:41.977132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 639/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:41.978323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:41.980676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.074909 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7d6f1-8944-455b-8069-0dde1eda2a28 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.109204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.109818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.110092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.110395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.111113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:42.111411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.112837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.129902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 642/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Aug 22 12:30:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:42.136209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.225456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.234852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69a77-27ed-4b1c-8a26-7594b1e9b485 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.267437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.268032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.268306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.268574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.335269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.336645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.424195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.434615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 640/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 12:30:42.440496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.505515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.543078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30ff9-f7e0-4ee9-b547-d51791024beb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.579348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.580011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.580390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.580668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.593263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.594724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 12:30:42.609292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:42.610495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 12:30:42.611596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 12:30:42.611596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 12:30:42.611596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:42.615508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 643/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 12:30:42.616392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.723422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24420-4053-4fa5-aca0-d34825e90dbf None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.758102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.758818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.759095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.759365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.760055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:42.760357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.761749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.777882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 641/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:30:42.780433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:42.883494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2096a3-3b9c-4713-9b83-7b561c3749f3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:42.897340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:42.918042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:42.918799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:42.919074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:42.919342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:42.926310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:42.927807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 12:30:42.948259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:42.949212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 22 12:30:42.950258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 644/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:42.955590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.008138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:43.060642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7023c7-114e-4fae-bb4f-ca81b28134c0 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.095390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.096223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.096659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.096924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.097606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:43.097905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.099365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d608-38f5-4642-b887-84b3f131b75b None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.112074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 642/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Mon Aug 22 12:30:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:43.119024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:43.224952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1a10c-2a2c-4c8e-9a64-d2ff6d4c5df5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:43.259235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:43.259834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:43.266326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:43.266326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:43.266326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] RBAC: Adding query filter params (role.id=4a6fa889264e479ba977b250b6f0a495, scope.project.id=93dc7b26e6af4baba62dc8470e2fd706, user.id=f2887cf82974425388d18660bf964fa9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:43.266326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:43.266326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987eef3-6ee5-4df9-909a-8fa1415012c8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:43.287947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 645/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Mon Aug 22 12:30:43 2022] GET /identity/v3/role_assignments?user.id=f2887cf82974425388d18660bf964fa9&scope.project.id=93dc7b26e6af4baba62dc8470e2fd706&role.id=4a6fa889264e479ba977b250b6f0a495 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:45.255216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ddb4-2431-4f72-84cf-3188f5747227 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.255741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ddb4-2431-4f72-84cf-3188f5747227 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.255741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ddb4-2431-4f72-84cf-3188f5747227 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.257131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 643/1288] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:45.263266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.263726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.263828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.282405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:45.283600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:45.315421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:45.353490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 646/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:45.623519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559ddb4-2431-4f72-84cf-3188f5747227 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:45.726853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559ddb4-2431-4f72-84cf-3188f5747227 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:45.738117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:45.761194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:45.761821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.762092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.762387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] PATH_INFO: `/v3/services/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.762962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:45.764303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:45.773141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:45.774866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:45.775778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 644/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:45.780816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:45.881388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfc857-7f92-4c89-b748-cbac5f322996 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:45.917097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:45.917710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:45.917984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:45.918323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:45.918946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:45.919242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:45.920597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cf32f-7940-4d32-848c-977e0a2e9795 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:45.925445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 647/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:45.931456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:46.053200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890806-08d2-4d3f-86a0-2b6d26b6d0db None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:46.092213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:46.092815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:46.093088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:46.093356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] PATH_INFO: `/v3/services` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:46.093978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:46.094297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:46.095689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7e16-d5e5-49ff-aeed-feedd94dbe41 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:46.100025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 645/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:48.017540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ee72-87aa-427e-9149-db3e9dfbc009 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:48.018099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ee72-87aa-427e-9149-db3e9dfbc009 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:48.018099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ee72-87aa-427e-9149-db3e9dfbc009 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:48.019470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 648/1293] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:48.024944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e288c9-837d-4925-9617-ae061730fc68 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:48.025408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e288c9-837d-4925-9617-ae061730fc68 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:48.025496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e288c9-837d-4925-9617-ae061730fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:48.044266 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-71e288c9-837d-4925-9617-ae061730fc68 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:48.045512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-71e288c9-837d-4925-9617-ae061730fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:48.075753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:48.113313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 646/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:48.382848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614ee72-87aa-427e-9149-db3e9dfbc009 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:48.415519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:48.487951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614ee72-87aa-427e-9149-db3e9dfbc009 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:48.523508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:48.524642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:48.524930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:48.525201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:48.525844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:48.527227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44240974-e75d-49af-8952-0335a9a0f88f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:48.689590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 649/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Mon Aug 22 12:30:48 2022] POST /identity/v3/services => generated 246 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:30:50.613895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f33f-60c6-478c-9832-6e0e16abf729 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.614421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f33f-60c6-478c-9832-6e0e16abf729 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.614421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64f33f-60c6-478c-9832-6e0e16abf729 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.615734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 647/1296] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:50.621550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:50.621957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:50.622099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:50.640765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:50.650238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:50.743927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 650/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:51.014675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64f33f-60c6-478c-9832-6e0e16abf729 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:51.117248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64f33f-60c6-478c-9832-6e0e16abf729 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:51.153303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:51.153921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:51.154251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:51.154500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:51.155065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:51.156475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:51.164938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:51.166341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:51.167337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 648/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:51.172107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:51.190242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:51.275306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88530eca-2006-4b86-a67e-db7e8abeb302 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:51.308228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:51.308831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:51.309108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:51.309379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:51.310000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:51.310339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:51.311705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:51.316915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 651/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:51.323829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:51.356055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:51.421778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d299-5143-4fda-8df7-544dcf7eb542 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:51.455536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:51.456124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:51.456399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:51.456668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:51.457345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] RBAC: Adding query filter params (interface=public, service_id=b61769a154b54fd587c2c29901909465, region_id=RegionOne) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:51.457646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:51.459306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd436e-98fe-46b5-a1cd-4072736c418d None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:51.464055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 649/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Mon Aug 22 12:30:51 2022] GET /identity/v3/endpoints?service_id=b61769a154b54fd587c2c29901909465&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:51.469837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:51.556374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:51.574938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa6bc0-828a-4a34-b6b8-9d8e6ee7f86b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:51.607848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:51.609564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:51.609564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:51.609564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:51.609564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:51.610919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65ff53-0305-45ba-b65b-29b3d7f7a85f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:51.617522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 652/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Mon Aug 22 12:30:51 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:30:53.523128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80c31-01fc-4675-9161-768124d6247e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:53.523697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80c31-01fc-4675-9161-768124d6247e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:53.523697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80c31-01fc-4675-9161-768124d6247e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:53.525073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 650/1302] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:30:53.530748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:53.537209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:53.537209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:53.550954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:30:53.552183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:30:53.625931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 653/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:30:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 12:30:53.893106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80c31-01fc-4675-9161-768124d6247e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:53.986623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:53.993185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80c31-01fc-4675-9161-768124d6247e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:54.025855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:54.026502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:54.026782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:54.027050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:54.027616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:54.028965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 12:30:54.037529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 12:30:54.038874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application with Lock( Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self._enter() Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application return self.creator() Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application created_value = creator( Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: ERROR keystone.server.flask.application Aug 22 12:30:54.040596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 651/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Aug 22 12:30:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 12:30:54.045176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:54.120536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:30:54.142659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fcc9e-aa22-47ae-be31-69846cfe98ed None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:54.175369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:54.175905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:54.176181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:54.176449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:54.177060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:30:54.177361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:54.178743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339ec25-3c73-4279-87d7-c11e9ff31e88 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:54.183712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 654/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Mon Aug 22 12:30:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:30:54.189450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:30:54.287746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765a7d1-ecba-4536-bb7f-e2c6f759b679 None admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:30:54.319483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:30:54.320077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:30:54.320366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:30:54.320618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:30:54.321770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:30:54.323149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831962-33b2-4b7e-ba9a-6df730891c84 None admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:30:54.501724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 652/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:30:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:31:04.227003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=30 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:31:04.497346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:30.726512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f14-7da0-489d-8b26-d508d2361ba2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:30.727589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f14-7da0-489d-8b26-d508d2361ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:30.728098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f14-7da0-489d-8b26-d508d2361ba2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:30.734908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdef19d-7d9b-4aae-8b06-4538fdfe0883 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:30.735749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdef19d-7d9b-4aae-8b06-4538fdfe0883 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:30.736236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdef19d-7d9b-4aae-8b06-4538fdfe0883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:30.740654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 655/1307] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:30 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:30.817250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0cdef19d-7d9b-4aae-8b06-4538fdfe0883 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:30.818870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0cdef19d-7d9b-4aae-8b06-4538fdfe0883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:30.936590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 653/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:38:31.245587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:31.245771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:31.246139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:31.247510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 656/1309] 10.222.0.15 () {54 vars in 965 bytes} [Mon Aug 22 12:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:31.254397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5315-8e83-42fe-b1cb-5b6491a38344 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:31.254768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5315-8e83-42fe-b1cb-5b6491a38344 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:31.255123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db5315-8e83-42fe-b1cb-5b6491a38344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:31.338654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-22db5315-8e83-42fe-b1cb-5b6491a38344 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:31.339961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-22db5315-8e83-42fe-b1cb-5b6491a38344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:31.362486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:31.419236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 654/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Mon Aug 22 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:31.428741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:31.430505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:31.551906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50a3fb-2780-45cd-a40c-d1bc1f6cd315 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:31.630956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:31.631571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:31.631852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:31.632124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:31.633725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:31.693784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:31.756349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:31.757816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb264b9-26a5-4c53-9987-d27b10daf496 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:31.781276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 657/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:34.021453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66c36-c109-4ec4-be98-aad086b4836d None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:34.021994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66c36-c109-4ec4-be98-aad086b4836d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:34.021994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66c36-c109-4ec4-be98-aad086b4836d None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:34.023516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 655/1312] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:34.028571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f9-6e19-4c74-980b-d13852445456 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:34.028957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f9-6e19-4c74-980b-d13852445456 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:34.029119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f9-6e19-4c74-980b-d13852445456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:34.122192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9eeec7f9-6e19-4c74-980b-d13852445456 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:34.123444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9eeec7f9-6e19-4c74-980b-d13852445456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:34.236279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 658/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:34.552717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:34.553003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:34.553280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:34.554680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 656/1314] 10.222.0.15 () {54 vars in 965 bytes} [Mon Aug 22 12:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:34.560908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b467e-3ad6-4602-88ee-012fc4f95bb4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:34.561274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b467e-3ad6-4602-88ee-012fc4f95bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:34.561699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b467e-3ad6-4602-88ee-012fc4f95bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:34.578589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:34.646773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f0b467e-3ad6-4602-88ee-012fc4f95bb4 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:34.649234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f0b467e-3ad6-4602-88ee-012fc4f95bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:34.725797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 659/1315] 10.222.0.15 () {58 vars in 1062 bytes} [Mon Aug 22 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:34.735479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:34.737496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:34.840764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d127f27-471b-4693-b6c8-10be8bc77897 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:34.913236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:34.915545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:34.916147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:34.916423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:34.916694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:34.918298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:35.025407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:35.026748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aa70d-7ea0-4fb8-87cf-732c74945f89 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:35.045849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 657/1316] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:37.661534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:37.662037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:37.662037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:37.663353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 660/1317] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:37.668645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fcb0-f1cd-46a3-83f7-396664481e2a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:37.669067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fcb0-f1cd-46a3-83f7-396664481e2a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:37.669180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fcb0-f1cd-46a3-83f7-396664481e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:37.737962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c3f0fcb0-f1cd-46a3-83f7-396664481e2a None None] MFA Rules not processed for user `6ef852dc81de44be839e711a9b299cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:37.739194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c3f0fcb0-f1cd-46a3-83f7-396664481e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:37.789489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:37.833907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 658/1318] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:38.117045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:38.118605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:38.219276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeffa1-a750-40d0-9c45-6640653d1ec3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:38.222139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:38.291720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:38.292325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:38.292602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:38.292869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:38.294474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:38.401170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:38.402564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb03e45-38a9-4c12-8d22-516d82126620 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:38.421149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 661/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:41.160433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:41.160968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:41.160968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:41.162333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 659/1320] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:41.167448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd83ba6-969d-461a-a9d1-a6ff8d382142 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:41.167860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd83ba6-969d-461a-a9d1-a6ff8d382142 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:41.167983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd83ba6-969d-461a-a9d1-a6ff8d382142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:41.208344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:41.233591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4cd83ba6-969d-461a-a9d1-a6ff8d382142 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:41.235131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4cd83ba6-969d-461a-a9d1-a6ff8d382142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:41.333152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 662/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:41.618887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:41.620423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:41.737187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8e59c-00c7-4d68-9831-581a9e087360 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:41.808861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:41.809454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:41.809731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:41.810001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:41.811653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:41.819477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:41.918711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:41.920055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f9eb2-054e-420f-a64a-beda9aaefa87 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:41.937750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 660/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:44.809171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:44.809726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:44.809726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:44.811098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 663/1323] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:44.816541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f38da-fd5d-4889-b308-f882ae849102 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:44.816970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f38da-fd5d-4889-b308-f882ae849102 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:44.817095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f38da-fd5d-4889-b308-f882ae849102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:44.882470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-682f38da-fd5d-4889-b308-f882ae849102 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:44.883661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-682f38da-fd5d-4889-b308-f882ae849102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:44.942255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:44.981086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 661/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:45.267259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:45.269410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:45.380256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5248873-00dc-4734-a5df-aadc1fc5932a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:45.393095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:45.454538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:45.455203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:45.455480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:45.455751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:45.457356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:45.565650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:45.567130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609253c-ed7d-4b6e-83f5-4bfc92cf3ee8 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:45.585092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 664/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:47.549306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:47.549822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:47.549822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:47.551149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 662/1326] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:47.556306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8395-2fb7-4850-b2f2-1b3f11f18f8d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:47.556713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8395-2fb7-4850-b2f2-1b3f11f18f8d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:47.557025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae8395-2fb7-4850-b2f2-1b3f11f18f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:47.605450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:47.622811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e1ae8395-2fb7-4850-b2f2-1b3f11f18f8d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:47.624435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e1ae8395-2fb7-4850-b2f2-1b3f11f18f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:47.723372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 665/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:48.006023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:48.007641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:48.129024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae851a2e-108b-462f-b4b3-dec5d5a47c45 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:48.201954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:48.202257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:48.202961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:48.202961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:48.206831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:48.226905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:48.326853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:48.328288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b944-7a4f-4b1f-9f0d-13afa0f4d8d2 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:48.348170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 663/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:50.294445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.294974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.295074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.296374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 666/1329] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:50.302466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0673-9ad8-47e3-9cf1-98e3fb7507f7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.302859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0673-9ad8-47e3-9cf1-98e3fb7507f7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.303015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0673-9ad8-47e3-9cf1-98e3fb7507f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.372883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b87e0673-9ad8-47e3-9cf1-98e3fb7507f7 None None] MFA Rules not processed for user `6ef852dc81de44be839e711a9b299cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:50.374109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b87e0673-9ad8-47e3-9cf1-98e3fb7507f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:50.447970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:50.483355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 664/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:50.780776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:50.782351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:50.907952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33962-895c-492f-baad-8792abf14dd5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:50.929615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:50.988277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:50.988878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:50.989152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:50.989419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:50.991021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:51.097439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:51.098877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92673e-62f3-4782-9961-d690c34ff706 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:51.116707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 667/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:53.640063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:53.640586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:53.640586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:53.641864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 665/1332] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:53.647054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165c03-b685-4bfa-8a53-9e345d052e08 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:53.647473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165c03-b685-4bfa-8a53-9e345d052e08 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:53.647641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a165c03-b685-4bfa-8a53-9e345d052e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:53.710647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:53.713238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8a165c03-b685-4bfa-8a53-9e345d052e08 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:53.714477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8a165c03-b685-4bfa-8a53-9e345d052e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:53.811798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 668/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:54.095369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:54.097491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:54.199554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ece87-d6fa-40cf-b38a-43788d191c3f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:54.272073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:54.272674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:54.272949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:54.273217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:54.274826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:54.302366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:54.382935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:54.384284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e8e2-02f3-45ce-8da0-42ac1c32d9d9 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:54.402874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 666/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:56.336647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:56.337120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:56.337243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:56.338544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 669/1335] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:56.343942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2f7c-b9a5-4286-86c0-ad6e781581bc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:56.344367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2f7c-b9a5-4286-86c0-ad6e781581bc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:56.344462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2f7c-b9a5-4286-86c0-ad6e781581bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:56.409418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-157b2f7c-b9a5-4286-86c0-ad6e781581bc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:56.410648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-157b2f7c-b9a5-4286-86c0-ad6e781581bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:56.483514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:56.505079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 667/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:38:56.787183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:38:56.788719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:56.891578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b7f80-a83a-4c01-ae06-670c3714e47f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:38:56.919560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:56.965892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:38:56.966523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:56.966800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:56.967071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:56.968932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:57.074902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:38:57.076320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896bd06-9f9a-44d8-86fa-ad813c69677b service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:38:57.094272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 670/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:38:59.595003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:59.596067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:59.596067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:59.597329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 668/1338] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:38:59.602638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231033e-cde4-4c48-a2b7-0abdea06283d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:38:59.603051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231033e-cde4-4c48-a2b7-0abdea06283d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:38:59.603184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231033e-cde4-4c48-a2b7-0abdea06283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:38:59.667390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b231033e-cde4-4c48-a2b7-0abdea06283d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:38:59.668580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b231033e-cde4-4c48-a2b7-0abdea06283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:38:59.677278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:38:59.767023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 671/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:00.046514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:00.048055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:00.152396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1228689-5b71-4d6a-b533-60c0e85fe4ec None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:00.227247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:00.227851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:00.228129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:00.228406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:00.229989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:00.264495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:00.340098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:00.341564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d5df-9a23-4766-aab7-8b76ec8d78d9 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:00.360790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 669/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:04.495034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:04.495491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:04.495682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:04.497092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 672/1341] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:04.503090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f840-9e65-4f8b-a8ba-c3a117395c8a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:04.503569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f840-9e65-4f8b-a8ba-c3a117395c8a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:04.503710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344f840-9e65-4f8b-a8ba-c3a117395c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:04.568902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d344f840-9e65-4f8b-a8ba-c3a117395c8a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:04.570109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d344f840-9e65-4f8b-a8ba-c3a117395c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:04.659765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:04.671064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 670/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:04.955716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:04.957279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:05.060813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305421-6b7d-4488-a8a5-2c9079df0e10 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:05.100229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:05.135918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:05.136518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:05.136792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:05.137058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:05.138840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:05.248504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:05.249971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbda01-afd0-4e3a-ab6f-c6df435f4520 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:05.269616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 673/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:08.244920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:08.245510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:08.245510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:08.246863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 671/1344] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:08.252721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080628c7-92e5-4bf9-bbd1-9e0e0d4650bc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:08.253120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080628c7-92e5-4bf9-bbd1-9e0e0d4650bc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:08.253270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080628c7-92e5-4bf9-bbd1-9e0e0d4650bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:08.321512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-080628c7-92e5-4bf9-bbd1-9e0e0d4650bc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:08.322741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-080628c7-92e5-4bf9-bbd1-9e0e0d4650bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:08.340742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:08.420569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 674/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:08.701578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:08.703160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:08.810959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1fc96-c120-4200-944f-23ad4bb0e35e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:08.894849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:08.895468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:08.895742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:08.896007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:08.897604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:08.948867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:09.019160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:09.020580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16502245-a5ec-4db4-8073-0ea747123224 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:09.038923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 672/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:13.071910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:13.072417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:13.072507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:13.074078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 675/1347] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:13.080250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a939-7f39-493e-9814-ab9b876339a7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:13.080662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a939-7f39-493e-9814-ab9b876339a7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:13.080781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a939-7f39-493e-9814-ab9b876339a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:13.150461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-40e2a939-7f39-493e-9814-ab9b876339a7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:13.151603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-40e2a939-7f39-493e-9814-ab9b876339a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:13.250825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:13.254222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 673/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:13.537590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:13.539149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:13.645171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6650c4-1a3f-4d92-a33a-b8f8e35b9dff None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:13.691822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:13.727210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:13.727812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:13.728087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:13.728360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:13.729950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:13.836996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:13.838461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3a86-e4a4-45be-a114-a20908b14f38 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:13.857739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 676/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:18.767816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173752d-e448-4f2c-b708-e1a02425c80e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:18.768633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173752d-e448-4f2c-b708-e1a02425c80e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:18.769082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173752d-e448-4f2c-b708-e1a02425c80e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:18.770605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 674/1350] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:18.785468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41de9-e444-4de6-8a2c-e4012833990b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:18.785908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41de9-e444-4de6-8a2c-e4012833990b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:18.786008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b41de9-e444-4de6-8a2c-e4012833990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:18.916721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-57b41de9-e444-4de6-8a2c-e4012833990b None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:18.918170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-57b41de9-e444-4de6-8a2c-e4012833990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:18.940477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:19.059874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 677/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:39:23.163222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c82b8-b275-4731-b831-55ba4b403a9d None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:23.164110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c82b8-b275-4731-b831-55ba4b403a9d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:23.164399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c82b8-b275-4731-b831-55ba4b403a9d None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:23.165946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 675/1352] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:23.170925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3d629-8c4f-48dd-966a-d32ebf366499 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:23.171342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3d629-8c4f-48dd-966a-d32ebf366499 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:23.171699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3d629-8c4f-48dd-966a-d32ebf366499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:23.251068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c2e3d629-8c4f-48dd-966a-d32ebf366499 None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:23.252776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c2e3d629-8c4f-48dd-966a-d32ebf366499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:23.333779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:23.376078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 678/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:24.642383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbaf4-d590-4fc8-8ee7-4bd2da59f750 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:24.642917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbaf4-d590-4fc8-8ee7-4bd2da59f750 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:24.642917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbaf4-d590-4fc8-8ee7-4bd2da59f750 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:24.644366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 676/1354] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:24.649241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f863ed-e8fb-4e60-9710-1698e4c29ec9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:24.649696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f863ed-e8fb-4e60-9710-1698e4c29ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:24.649805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f863ed-e8fb-4e60-9710-1698e4c29ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:24.729951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-54f863ed-e8fb-4e60-9710-1698e4c29ec9 None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:24.731214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-54f863ed-e8fb-4e60-9710-1698e4c29ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:24.842500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 679/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:28.221937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5b4-bf0d-4bc1-934b-e52205302a6e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:28.221937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5b4-bf0d-4bc1-934b-e52205302a6e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:28.221937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5b4-bf0d-4bc1-934b-e52205302a6e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:28.224940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 677/1356] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:28.228581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220b37-8aa2-49a7-befb-2c77e88eb8e1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:28.229030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220b37-8aa2-49a7-befb-2c77e88eb8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:28.229136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220b37-8aa2-49a7-befb-2c77e88eb8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:28.275033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:28.318794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ef220b37-8aa2-49a7-befb-2c77e88eb8e1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:28.320285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef220b37-8aa2-49a7-befb-2c77e88eb8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:28.445613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 680/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:28.744984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:28.745626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:28.746402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:28.747950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 678/1358] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 12:39:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:28.757190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab338-d3d3-4e0e-877a-82db47eda037 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:28.757703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab338-d3d3-4e0e-877a-82db47eda037 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:28.758369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ab338-d3d3-4e0e-877a-82db47eda037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:28.842313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6e5ab338-d3d3-4e0e-877a-82db47eda037 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:28.843806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e5ab338-d3d3-4e0e-877a-82db47eda037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:28.899450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:28.974358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 681/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:39:28.978104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:28.979904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:29.155639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5bd4-0ddf-4926-af9a-fc59fe9148ba None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:29.236494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:29.292704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:29.298104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:29.298104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:29.298104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:29.298104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:29.387624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:29.389152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a552d4-ad4c-41a7-80b8-e6c1aad69695 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:29.407811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 679/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:31.529846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:31.530413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:31.530607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:31.532350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 682/1361] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:31.537812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c8bf-516a-464f-ac89-894d12c91fda None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:31.538376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c8bf-516a-464f-ac89-894d12c91fda None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:31.538464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51c8bf-516a-464f-ac89-894d12c91fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:31.608750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4d51c8bf-516a-464f-ac89-894d12c91fda None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:31.610103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4d51c8bf-516a-464f-ac89-894d12c91fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:31.650920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:31.716879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 680/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:32.009531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:32.011679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:32.175524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3be9c6-5911-444a-bc01-4fe7ab047af2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:32.186075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:32.303730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:32.304346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:32.304630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:32.305009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:32.306649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:32.407464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:32.409058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dd7ba-8cbb-4865-af74-59c839bc0e9f service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:32.430051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 683/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:34.839608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cdf3e-c20f-4c2c-9244-becb9a37f957 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:34.840137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cdf3e-c20f-4c2c-9244-becb9a37f957 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:34.840137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cdf3e-c20f-4c2c-9244-becb9a37f957 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:34.841662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 681/1364] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:34.847422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1de2-87a8-4549-a3a5-38799b2b3635 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:34.847825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1de2-87a8-4549-a3a5-38799b2b3635 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:34.848009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c1de2-87a8-4549-a3a5-38799b2b3635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:34.864703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:34.917161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1c3c1de2-87a8-4549-a3a5-38799b2b3635 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:34.918401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1c3c1de2-87a8-4549-a3a5-38799b2b3635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.030641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 684/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:35.326359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.326841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.327766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.328889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 682/1366] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 12:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:35.334874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e185-c0c8-439b-8de4-a4d8bb37f5e2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.335270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e185-c0c8-439b-8de4-a4d8bb37f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.335658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e185-c0c8-439b-8de4-a4d8bb37f5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.420891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1a86e185-c0c8-439b-8de4-a4d8bb37f5e2 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:35.422296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1a86e185-c0c8-439b-8de4-a4d8bb37f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.460428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:35.547531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 685/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:35.556087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:35.557749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:35.718494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff3126-f9d4-4425-98b9-7893e9756a2d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:35.740651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:35.845949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:35.846646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:35.846740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:35.847016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:35.848602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:36.061631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:36.063511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e6ab9-4900-4b68-bddf-416e5dfd472f service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:36.082826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 683/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:36.403907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bf04-4131-4b5d-8090-47831b766ef4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:36.404339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bf04-4131-4b5d-8090-47831b766ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:36.404465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737bf04-4131-4b5d-8090-47831b766ef4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:36.405883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 686/1369] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:36.412062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ec00-f698-4695-8cd9-698509d5a336 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:36.412818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ec00-f698-4695-8cd9-698509d5a336 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:36.412818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ec00-f698-4695-8cd9-698509d5a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:36.452948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:36.502453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c4d0ec00-f698-4695-8cd9-698509d5a336 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:36.504093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c4d0ec00-f698-4695-8cd9-698509d5a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:36.618766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 684/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:37.198069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:37.198069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:37.198069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:37.200558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 687/1371] 10.222.0.15 () {54 vars in 964 bytes} [Mon Aug 22 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:37.203772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c71a5-3153-424e-8f5f-7e648c6d5717 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:37.204252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c71a5-3153-424e-8f5f-7e648c6d5717 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:37.204415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c71a5-3153-424e-8f5f-7e648c6d5717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:37.298055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d53c71a5-3153-424e-8f5f-7e648c6d5717 None None] MFA Rules not processed for user `384e6654dbac4182900d6326eb23182b`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:37.300106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d53c71a5-3153-424e-8f5f-7e648c6d5717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:37.357984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:37.390394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 685/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Aug 22 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:37.402622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:37.404363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:37.518069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d3df-2ecc-480f-bd02-79fad5c4e25e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:37.562497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:37.596913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:37.597519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:37.597794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:37.598062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:37.599678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:37.722561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:37.724245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6bd06-1355-4eb1-9f1c-d56611578b1b service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:37.746551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 688/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:38.289900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:38.290379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:38.290562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:38.291987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 686/1374] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:38.297261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1359ce-a9d6-43dc-8f35-3d52e1609c9d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:38.297548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1359ce-a9d6-43dc-8f35-3d52e1609c9d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:38.297819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1359ce-a9d6-43dc-8f35-3d52e1609c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:38.369228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6d1359ce-a9d6-43dc-8f35-3d52e1609c9d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:38.370466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6d1359ce-a9d6-43dc-8f35-3d52e1609c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:38.392811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:38.470871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 689/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:38.757944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:38.759468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:38.908388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ebd8e-0905-4a0d-9b0f-b453be004a94 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:38.960658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:39.022697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:39.023320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:39.023855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:39.024865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:39.026554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:39.117863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:39.119495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89bb1a-cb70-40cc-a7a3-839c8e55e9c3 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:39.137582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 687/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:41.151863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.152380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.152380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.153735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 690/1377] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:41.159652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672c4f-c093-4000-991e-6cbb42621a3b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.160052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672c4f-c093-4000-991e-6cbb42621a3b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.160188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672c4f-c093-4000-991e-6cbb42621a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.234198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-34672c4f-c093-4000-991e-6cbb42621a3b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:41.235404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-34672c4f-c093-4000-991e-6cbb42621a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:41.242565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:41.370888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 688/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:41.669701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:41.671266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:41.826778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47bf1-9d0b-49a3-8be6-673bb9194a99 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:41.831384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:41.955598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:41.956117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:41.956380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:41.956654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:41.958265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:42.054196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:42.055820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ae603-ffc8-40f9-81c9-f673a763bf4e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:42.074539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 691/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:44.153758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d0216-402f-4175-bce1-539c96436eaa None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.154516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d0216-402f-4175-bce1-539c96436eaa None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.154516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d0216-402f-4175-bce1-539c96436eaa None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.155806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 689/1380] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:44.161048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bc85-d380-4169-8f84-0aba7442580d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.161436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bc85-d380-4169-8f84-0aba7442580d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.161601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bc85-d380-4169-8f84-0aba7442580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.174489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:44.245223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5705bc85-d380-4169-8f84-0aba7442580d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:44.246487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5705bc85-d380-4169-8f84-0aba7442580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:44.493002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 692/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:44.654972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d0216-402f-4175-bce1-539c96436eaa None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:44.656622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-147d0216-402f-4175-bce1-539c96436eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:44.804259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:44.815493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d0216-402f-4175-bce1-539c96436eaa None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:44.930770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:44.931359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:44.931626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:44.931891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:44.934080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:45.027071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:45.028922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09477e8-78a4-4ec9-a0f8-a7434a5bfe7c service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:45.039571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:45.049574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 690/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:47.605211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:47.605718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:47.605841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:47.607576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 693/1383] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:47.613692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5357-5013-4c12-a0b0-0ace1f788882 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:47.614101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5357-5013-4c12-a0b0-0ace1f788882 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:47.614270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5357-5013-4c12-a0b0-0ace1f788882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:47.680721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d72b5357-5013-4c12-a0b0-0ace1f788882 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:47.681928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d72b5357-5013-4c12-a0b0-0ace1f788882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:47.781550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 691/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:48.070955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:48.073101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:48.177968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:48.241229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7022-225f-4d3d-8b2a-f1520b34e9f7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:48.364225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:48.364835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:48.365259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:48.365525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:48.367175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:48.422196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:48.463437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:48.465057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf3b72-21a0-44fc-b3ba-90c9a2e5ab00 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:48.483893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 694/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:50.405972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:50.406565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:50.406565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:50.408545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 692/1386] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:50.414009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d108-5d0e-4609-80d7-9f7b8fa677b9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:50.414458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d108-5d0e-4609-80d7-9f7b8fa677b9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:50.414587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d108-5d0e-4609-80d7-9f7b8fa677b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:50.489745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-bd00d108-5d0e-4609-80d7-9f7b8fa677b9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:50.491000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bd00d108-5d0e-4609-80d7-9f7b8fa677b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:50.615988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 695/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:39:50.909758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:50.911753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:51.001987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:51.073544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71fc7c-4656-4d59-b7f7-438077a9e368 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:51.189790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:51.190401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:51.190683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:51.190951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:51.192546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:51.232117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:51.290625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:51.292237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3cfe-3581-496e-9f02-54c5e7758f3b service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:51.315124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 693/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:52.983556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585a01-9f60-42f1-9753-c2d89074d08c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:52.984129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585a01-9f60-42f1-9753-c2d89074d08c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:52.984129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9585a01-9f60-42f1-9753-c2d89074d08c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:52.985476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 696/1389] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:52.990946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd502-1406-4127-8c7c-16bf3556bdd4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:52.991362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd502-1406-4127-8c7c-16bf3556bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:52.991619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dddd502-1406-4127-8c7c-16bf3556bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.059428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9dddd502-1406-4127-8c7c-16bf3556bdd4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:53.060639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9dddd502-1406-4127-8c7c-16bf3556bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.160416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 694/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:53.346159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d48ccb-bd59-4d0f-bd81-51106537efb3 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.346478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d48ccb-bd59-4d0f-bd81-51106537efb3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.346753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d48ccb-bd59-4d0f-bd81-51106537efb3 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.348134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 697/1391] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:53.353609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.353901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.354237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.371571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:53.423939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:53.425368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.464783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5266d-1827-4df0-aec9-54bc5daf7f2c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.465071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5266d-1827-4df0-aec9-54bc5daf7f2c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.465342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5266d-1827-4df0-aec9-54bc5daf7f2c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.466759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 698/1392] 10.222.0.15 () {54 vars in 967 bytes} [Mon Aug 22 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:39:53.472480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.472755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.473026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.504502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:53.528851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:53.550867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] MFA Rules not processed for user `f21a5d7a9a2043adb471333fd3589f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:53.552007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.628433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 699/1394] 10.222.0.15 () {58 vars in 1064 bytes} [Mon Aug 22 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:39:53.635965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:53.637169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.727360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e39db-1e02-45da-9dda-54a497c5af20 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:53.735001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:53.801788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:53.802373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:53.802671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:53.802943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:53.804554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.816939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:53.818157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:53.924191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:53.925769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ae47-1311-4b35-96f0-dc79bcbb0581 service glance] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:53.939773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f3f3-a043-46bb-9200-7126e9b6fe22 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:53.943858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:53.945680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 696/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:54.055702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:54.056302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:54.057154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:54.057437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:54.059096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:54.156320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:54.158020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512dd3-8602-4e29-a9d7-345584aaf3d7 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:54.179626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 700/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:39:54.818661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847428f2-5c1c-470d-bf74-d4c4096efbd6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:54.819180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847428f2-5c1c-470d-bf74-d4c4096efbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:54.819295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847428f2-5c1c-470d-bf74-d4c4096efbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:54.865169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:54.890020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-847428f2-5c1c-470d-bf74-d4c4096efbd6 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:54.891730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-847428f2-5c1c-470d-bf74-d4c4096efbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:54.991635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 697/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:55.034475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:55.034757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:55.035024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:55.036376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 701/1398] 10.222.0.15 () {54 vars in 943 bytes} [Mon Aug 22 12:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:55.042472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b647f-ae22-48db-9b99-bdd23f3829fb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:55.042851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b647f-ae22-48db-9b99-bdd23f3829fb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:55.043194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b647f-ae22-48db-9b99-bdd23f3829fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:55.119200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-304b647f-ae22-48db-9b99-bdd23f3829fb None None] MFA Rules not processed for user `4375f94a202a43c3abf6b36dd1eb01dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:55.120390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-304b647f-ae22-48db-9b99-bdd23f3829fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:55.180022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:55.225551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 698/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Mon Aug 22 12:39:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:55.234637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:55.236187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:55.245949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:55.386951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809218f-624a-43c1-bfc1-2dbb665d8e01 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:55.486829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:55.494823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:55.495233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:55.495509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:55.495781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:55.497608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:55.591461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:55.594673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d4a11-3639-43e3-9adb-d0570a4cebb6 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:55.603100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 702/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:39:56.546298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:56.546801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:56.546801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:56.548141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 699/1401] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:56.554140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f218-fef0-4633-a0b9-f4dcb07b332e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:56.554655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f218-fef0-4633-a0b9-f4dcb07b332e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:56.554774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247f218-fef0-4633-a0b9-f4dcb07b332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:56.627254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c247f218-fef0-4633-a0b9-f4dcb07b332e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:56.628458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c247f218-fef0-4633-a0b9-f4dcb07b332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:56.721166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:56.740291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 703/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:39:57.034648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:39:57.037347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:57.210056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1eecf-f9d5-4f08-8957-9a948ae7eb78 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:39:57.251621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:57.349584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:39:57.350538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:57.350860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:57.351180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:57.353148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:57.461429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:39:57.463322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c3dd-1598-49e7-9d16-a6614247de53 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:39:57.482420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 700/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:39:59.617190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.617712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.617712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.619433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 704/1404] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:39:59.625559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299958a-574b-4fc2-942c-3b5f7e12b9c1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:39:59.625559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299958a-574b-4fc2-942c-3b5f7e12b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:39:59.625559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299958a-574b-4fc2-942c-3b5f7e12b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:39:59.689285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:39:59.699324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a299958a-574b-4fc2-942c-3b5f7e12b9c1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:39:59.702457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a299958a-574b-4fc2-942c-3b5f7e12b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:39:59.808756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 701/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:00.098296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:00.099835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.291879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc11bd5-95af-4704-8558-d5cc7e633df7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:00.370544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:00.433408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:00.486226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:00.486226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:00.486226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:00.486226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:00.562768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:00.564587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946392e-cbb6-400a-8870-539e0e0bc504 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:00.590304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 705/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:03.504585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:03.505161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:03.505161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:03.506664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 702/1407] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:03.511837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bd33-c345-4ff2-b6c0-b56e44ab27fd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:03.512272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bd33-c345-4ff2-b6c0-b56e44ab27fd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:03.512381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400bd33-c345-4ff2-b6c0-b56e44ab27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:03.583102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b400bd33-c345-4ff2-b6c0-b56e44ab27fd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:03.584593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b400bd33-c345-4ff2-b6c0-b56e44ab27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:03.608103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:03.692436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 706/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:03.983666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:03.985203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:04.117198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:04.146792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c65905-27b7-44ef-8959-03e737c15500 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:04.275632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:04.275632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:04.275959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:04.275959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:04.277811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:04.380514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:04.384949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:04.386587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5077-88c1-4753-90de-9567d87c9000 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:04.430814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:13.690678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=33 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:14.446951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=7 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:19.692199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fbf2-7077-45f0-a3a2-be81c9888ac7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:19.692725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fbf2-7077-45f0-a3a2-be81c9888ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:19.692725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fbf2-7077-45f0-a3a2-be81c9888ac7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:19.694096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 707/1410] 10.222.0.15 () {54 vars in 918 bytes} [Mon Aug 22 12:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:19.699296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d0bd-b4e6-4047-a0cd-010c485f1d0b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:19.699697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d0bd-b4e6-4047-a0cd-010c485f1d0b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:19.699830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d0bd-b4e6-4047-a0cd-010c485f1d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:19.774195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2f29d0bd-b4e6-4047-a0cd-010c485f1d0b None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:19.775410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2f29d0bd-b4e6-4047-a0cd-010c485f1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:19.878138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 22 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:19.892261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070499d-d6fc-4929-8df6-922b5ea356a1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:19.892546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070499d-d6fc-4929-8df6-922b5ea356a1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:19.892822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070499d-d6fc-4929-8df6-922b5ea356a1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:19.894141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 708/1412] 10.222.0.15 () {54 vars in 918 bytes} [Mon Aug 22 12:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:19.898585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcdc74-e9b2-408c-99de-68acba92d0b9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:19.898976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcdc74-e9b2-408c-99de-68acba92d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:19.899253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcdc74-e9b2-408c-99de-68acba92d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:19.971019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:19.973390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d2fcdc74-e9b2-408c-99de-68acba92d0b9 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:19.974624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d2fcdc74-e9b2-408c-99de-68acba92d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:20.088282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Aug 22 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:22.464874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:22.465421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:22.465421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:22.466765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:22.472475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ddb4-3e36-4f3f-9d8b-321390860009 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:22.472901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ddb4-3e36-4f3f-9d8b-321390860009 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:22.473005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ddb4-3e36-4f3f-9d8b-321390860009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:22.537519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6fe9ddb4-3e36-4f3f-9d8b-321390860009 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:22.538780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6fe9ddb4-3e36-4f3f-9d8b-321390860009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:22.594587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:22.635256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:22.924259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:22.925759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:23.198292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c58c2-8f2f-4ece-a3f3-81b1823a2157 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:23.272365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:23.312965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:23.314207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:23.314486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:23.314758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:23.316330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:23.404103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:23.405696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d46d7-a0aa-40f7-aa65-05202c2abffb service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:23.423886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 710/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:40:24.321444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:24.321902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:24.322025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:24.323381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:24.328392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77416fb-d82a-4ae7-9d05-ff634663a5ac None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:24.328828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77416fb-d82a-4ae7-9d05-ff634663a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:24.328941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77416fb-d82a-4ae7-9d05-ff634663a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:24.403847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c77416fb-d82a-4ae7-9d05-ff634663a5ac None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:24.405038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c77416fb-d82a-4ae7-9d05-ff634663a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:24.432278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:24.506540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:24.656481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:24.658011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:24.809893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47961-4783-43ef-b1a5-b76c167186db None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:24.849479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:24.921448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:24.922357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:24.923301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:24.932528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:24.932528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:25.013959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:25.015579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057699a4-2659-45c5-bf66-6e7c6a17d3d4 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:25.033737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:25.908308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:25.908877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:25.908877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:25.910224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:25.915138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b429-99e6-494e-a6e3-94fb9a67e5cc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:25.915548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b429-99e6-494e-a6e3-94fb9a67e5cc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:25.915678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b429-99e6-494e-a6e3-94fb9a67e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:25.968983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:25.991569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bdf9b429-99e6-494e-a6e3-94fb9a67e5cc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:25.992751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bdf9b429-99e6-494e-a6e3-94fb9a67e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:26.084710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:26.237442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:26.238933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:26.384342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61250a8-5848-4ba0-8350-e50792389bc1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:26.396686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:26.496544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:26.497088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:26.497341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:26.497607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:26.499222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:26.586971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:26.588544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7e2e5-9bfb-42e3-aeb0-b10bda33ce5f service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:26.606946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 713/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:27.461892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:27.462479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:27.462603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:27.463877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:27.468689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12bb8-ece2-4b39-b52f-89d60ad8e0c1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:27.469072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12bb8-ece2-4b39-b52f-89d60ad8e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:27.469235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af12bb8-ece2-4b39-b52f-89d60ad8e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:27.489561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:27.546409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3af12bb8-ece2-4b39-b52f-89d60ad8e0c1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:27.547534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3af12bb8-ece2-4b39-b52f-89d60ad8e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:27.650309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:27.800016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:27.801430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:27.913638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:27.948469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8ce5a-de84-4316-b670-d708ca663c6c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:28.060863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:28.061395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:28.061661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:28.061924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:28.064046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:28.137720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:28.151243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:28.152823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a0c59-2385-4470-bee2-a378425c835a service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:28.170194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 711/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:29.031234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:29.031785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:29.031785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:29.033090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:29.038155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ef34-2adb-4ed7-a9ca-c68a82d2580a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:29.038595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ef34-2adb-4ed7-a9ca-c68a82d2580a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:29.038743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ef34-2adb-4ed7-a9ca-c68a82d2580a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:29.114557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e995ef34-2adb-4ed7-a9ca-c68a82d2580a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:29.115758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e995ef34-2adb-4ed7-a9ca-c68a82d2580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:29.210123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:29.364689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:29.366201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:29.448099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:29.508236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9653e-1fe6-4ae3-84bb-37cce677733c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:29.621395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:29.621991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:29.622293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:29.622562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:29.624148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:29.671670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:29.714011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:29.715653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854af90-08bc-434a-8dad-9c8ccc9546bc service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:29.733570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 716/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:30.606676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea75-b524-487a-848e-a8755a222bed None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:30.607180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea75-b524-487a-848e-a8755a222bed None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:30.607287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347ea75-b524-487a-848e-a8755a222bed None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:30.608554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:30.613950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b9c1-0281-40eb-837a-3c3a390d742c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:30.614446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b9c1-0281-40eb-837a-3c3a390d742c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:30.614580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416b9c1-0281-40eb-837a-3c3a390d742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:30.688883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7416b9c1-0281-40eb-837a-3c3a390d742c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:30.690086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7416b9c1-0281-40eb-837a-3c3a390d742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:30.786018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:30.935545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347ea75-b524-487a-848e-a8755a222bed None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:30.936999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a347ea75-b524-487a-848e-a8755a222bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:30.985487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:31.082362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347ea75-b524-487a-848e-a8755a222bed None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:31.193980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:31.194576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:31.194856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:31.195128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:31.196721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:31.203579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:31.293889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:31.295512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e488e-d164-49e1-9eac-86813b3cddb5 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:31.313721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 714/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:32.198173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:32.198761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:32.198761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:32.200422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:32.205270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1e3d-c341-441c-b147-52672b9555f3 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:32.205648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1e3d-c341-441c-b147-52672b9555f3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:32.205812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef1e3d-c341-441c-b147-52672b9555f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:32.279544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0eef1e3d-c341-441c-b147-52672b9555f3 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:32.280754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0eef1e3d-c341-441c-b147-52672b9555f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:32.347233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:32.376515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:32.533873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:32.535364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:32.552632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:32.680844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545602fb-cdc5-454c-b2f8-ab93d2feaf53 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:32.767476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:32.793965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:32.794596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:32.794868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:32.795133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:32.796706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:32.884516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:32.886093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520a5a-d23c-44f6-b6f7-538dfaea494f service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:32.904278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 719/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:33.787673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:33.788249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:33.788249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:33.789651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:33.794856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e7e5-73c8-46ac-83c6-f12850321a3a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:33.795278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e7e5-73c8-46ac-83c6-f12850321a3a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:33.795404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3e7e5-73c8-46ac-83c6-f12850321a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:33.870590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e7b3e7e5-73c8-46ac-83c6-f12850321a3a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:33.871782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e7b3e7e5-73c8-46ac-83c6-f12850321a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:33.913085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:33.967698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:34.119385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:34.120843 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:34.264173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5b58f-5959-4c61-b44e-ff9ee64d6834 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:34.317657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:34.374746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:34.375276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:34.375547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:34.375811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:34.377927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:34.465490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:34.467154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e6c3b-9f48-46bc-8a83-2dc5a43847dc service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:34.484867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 717/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:35.337923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.338409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.338512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:35.339852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:35.345011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec483-4899-4f4f-ae05-d899dbd0450a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.345992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec483-4899-4f4f-ae05-d899dbd0450a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.346243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ec483-4899-4f4f-ae05-d899dbd0450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:35.420359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-df3ec483-4899-4f4f-ae05-d899dbd0450a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:35.421556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-df3ec483-4899-4f4f-ae05-d899dbd0450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:35.423604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:35.516634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:35.667669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:35.669198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:35.811184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378bb69-e00a-4b28-9ab5-49e52fea3189 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:35.837110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:35.922906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:35.923452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:35.923723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:35.923986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:35.925557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:36.012763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:36.014368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f15207-8d1a-43ab-9964-5d8e1473e326 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:36.032373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 722/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:37.843469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:37.844057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:37.844057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:37.845642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:37.850888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee73b-85e6-4e88-8526-5eb92c5f199a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:37.851290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee73b-85e6-4e88-8526-5eb92c5f199a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:37.851423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ee73b-85e6-4e88-8526-5eb92c5f199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:37.891291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:37.915858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d86ee73b-85e6-4e88-8526-5eb92c5f199a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:37.917040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d86ee73b-85e6-4e88-8526-5eb92c5f199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:38.011744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:38.294932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:38.296455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:38.397625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46229ea-fbc8-4c3b-9d24-f17eb70c7ee5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:38.428794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:38.468753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:38.469341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:38.469612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:38.470148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:38.471730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:38.581425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:38.582877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc39d5c-feed-4299-9793-bf3b358b3085 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:38.603062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 720/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:40.650577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:40.651136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:40.651136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:40.652489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:40.658272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734f09e-ef1a-45d2-906c-112f01ccc49a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:40.658691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734f09e-ef1a-45d2-906c-112f01ccc49a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:40.658821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734f09e-ef1a-45d2-906c-112f01ccc49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:40.722448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9734f09e-ef1a-45d2-906c-112f01ccc49a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:40.723618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9734f09e-ef1a-45d2-906c-112f01ccc49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:40.735879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:40.816745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:41.097710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:41.099276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:41.201024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f7510-2525-404f-9820-c5bff82b0bce None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:41.212822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:41.273904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:41.274561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:41.274838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:41.275108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:41.276688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:41.384205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:41.385567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6a70-ce02-459e-b330-aad0f345a7b6 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:41.404128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 725/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:43.670606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22902426-807b-4e91-9455-0e04da277b2e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:43.671131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22902426-807b-4e91-9455-0e04da277b2e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:43.671131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22902426-807b-4e91-9455-0e04da277b2e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:43.672458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:43.677748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59683-e5b5-4f86-82a9-e69549ca4914 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:43.678148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59683-e5b5-4f86-82a9-e69549ca4914 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:43.678324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59683-e5b5-4f86-82a9-e69549ca4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:43.726783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:43.743939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-43a59683-e5b5-4f86-82a9-e69549ca4914 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:43.745119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-43a59683-e5b5-4f86-82a9-e69549ca4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:43.841671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:44.122560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22902426-807b-4e91-9455-0e04da277b2e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:44.124090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-22902426-807b-4e91-9455-0e04da277b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:44.225595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22902426-807b-4e91-9455-0e04da277b2e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:44.264998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:44.298777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:44.299385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:44.299660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:44.299931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:44.301509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:44.406961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:44.408290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b83d1-f860-4a3e-8a90-fca34a4b9093 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:44.426599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 723/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:46.437472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:46.438001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:46.438001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:46.439987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:46.445121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a2bc-5c80-4468-9869-1bd61be517b1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:46.445584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a2bc-5c80-4468-9869-1bd61be517b1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:46.445858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a2bc-5c80-4468-9869-1bd61be517b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:46.512147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9ef0a2bc-5c80-4468-9869-1bd61be517b1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:46.513343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9ef0a2bc-5c80-4468-9869-1bd61be517b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:46.533615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:46.608531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:46.892392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:46.893924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:46.996239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b378-b0dc-4da3-bc8a-6ce9e90cda21 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:47.015761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:47.074208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:47.074828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:47.075108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:47.075372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:47.077264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:47.185145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:47.186590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed36b0-a5c9-4ef8-b9b5-0b125f72311d service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:47.204135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 728/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:49.170154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:49.170713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:49.170845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:49.172084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:49.177842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361192e-38ee-46bf-9a46-f05a5d12e9bf None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:49.178295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361192e-38ee-46bf-9a46-f05a5d12e9bf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:49.178421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361192e-38ee-46bf-9a46-f05a5d12e9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:49.241168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:49.243749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3361192e-38ee-46bf-9a46-f05a5d12e9bf None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:49.244946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3361192e-38ee-46bf-9a46-f05a5d12e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:49.340111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:49.621298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:49.622868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:49.727873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa501-889d-404f-ab98-61c76a50dfba None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:49.775558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:49.800642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:49.801242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:49.801518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:49.801782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:49.803388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:49.910500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:49.911849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f7163-8e5a-4325-91b3-4871fbf16465 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:49.930532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 726/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:51.874655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:51.875217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:51.875217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:51.877187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:51.882577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb57f-d722-4161-a581-766998fa61e1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:51.882986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb57f-d722-4161-a581-766998fa61e1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:51.883119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdeb57f-d722-4161-a581-766998fa61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:51.951046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1cdeb57f-d722-4161-a581-766998fa61e1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:51.952261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1cdeb57f-d722-4161-a581-766998fa61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:51.980713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:52.047105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:52.336895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:52.338499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:52.468141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ec4a-e56e-42b7-b849-07f964ce01a2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:52.496280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:52.543247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:52.543800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:52.544076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:52.544344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:52.545959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:52.652072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:52.653484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cea89-a9fa-4f2a-9cb9-58725c563051 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:52.672066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 731/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:54.640989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:54.641564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:54.641564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:54.643527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:40:54.648769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e494-c221-40fe-b5fc-69f5244faddd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:54.649202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e494-c221-40fe-b5fc-69f5244faddd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:54.649319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29e494-c221-40fe-b5fc-69f5244faddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:54.713720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8f29e494-c221-40fe-b5fc-69f5244faddd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:54.714945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f29e494-c221-40fe-b5fc-69f5244faddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:54.723421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:54.812392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:40:55.093591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:55.095727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:55.196085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebb6bd-3d94-4204-a65c-4ab59f69aa34 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:55.249903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:55.268384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:55.268984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:55.269254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:55.269520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:55.271129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:55.385365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:55.386743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dfefe-2c43-4577-8496-04f3077c451e service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:55.405274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 729/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:40:57.432692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:57.433227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:57.433227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:57.434521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:40:57.440564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc0a0-f926-47db-ac96-94d583ebb460 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:57.440985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc0a0-f926-47db-ac96-94d583ebb460 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:57.441101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befc0a0-f926-47db-ac96-94d583ebb460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:57.508467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7befc0a0-f926-47db-ac96-94d583ebb460 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:40:57.509657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7befc0a0-f926-47db-ac96-94d583ebb460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:57.547824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:57.605972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:40:57.894746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:40:57.896316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:58.000577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722a6bc-e5be-4d08-a317-5cdc770ef560 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:40:58.038525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:40:58.074424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:40:58.075032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:40:58.075310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:40:58.075578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:40:58.077255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:40:58.185184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:40:58.186572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00293-6e4a-45c6-8929-0ca5ced1b0d4 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:40:58.205805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 734/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:00.119890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:00.120457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:00.120457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:00.121824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:00.127999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443c44-39ee-42ea-b6a9-a8a0a6e43ea1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:00.128404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443c44-39ee-42ea-b6a9-a8a0a6e43ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:00.132921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37443c44-39ee-42ea-b6a9-a8a0a6e43ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:00.194224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-37443c44-39ee-42ea-b6a9-a8a0a6e43ea1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:00.195456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-37443c44-39ee-42ea-b6a9-a8a0a6e43ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:00.214325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:00.294148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:41:00.574670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:00.576228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:00.679177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f645dfe-43e1-485d-b541-bd5db65294dd None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:00.744368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:00.750961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:00.756228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:00.756228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:00.756228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:00.756228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:00.863105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:00.864601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39dd4-438c-4034-aacd-572459abd6e0 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:00.884126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 732/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:02.802513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:02.803043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:02.803157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:02.804454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:02.809977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1546d-08f8-424b-ba89-77f6f301a17a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:02.810431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1546d-08f8-424b-ba89-77f6f301a17a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:02.810599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1546d-08f8-424b-ba89-77f6f301a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:02.884752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8ec1546d-08f8-424b-ba89-77f6f301a17a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:02.885877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8ec1546d-08f8-424b-ba89-77f6f301a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:02.934085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:02.981736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:03.266427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:03.268625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:03.370369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d89d32-2cf1-44ba-b616-0745f1134de8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:03.417495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:03.443697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:03.444384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:03.445874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:03.446165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:03.447811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:03.555868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:03.557282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f31109-ce31-4463-a478-e0979cee338f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:03.575344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 737/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:12.979939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=22 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:13.573126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=66 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:23.064927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c323-875b-4977-93a4-9208ff1182d8 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:23.065529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c323-875b-4977-93a4-9208ff1182d8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:23.065529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0c323-875b-4977-93a4-9208ff1182d8 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:23.067000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 734/1471] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:23.072209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554972fa-2c4c-425d-879c-5a6bea905da7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:23.072647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554972fa-2c4c-425d-879c-5a6bea905da7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:23.072767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554972fa-2c4c-425d-879c-5a6bea905da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:23.137289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-554972fa-2c4c-425d-879c-5a6bea905da7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:23.138493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-554972fa-2c4c-425d-879c-5a6bea905da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:23.239455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 738/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:23.544063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:23.549814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:23.549814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:23.549814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 735/1473] 10.222.0.15 () {54 vars in 967 bytes} [Mon Aug 22 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:23.551790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6550-3ab0-4037-bf5d-543256d8222d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:23.552075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6550-3ab0-4037-bf5d-543256d8222d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:23.552348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6550-3ab0-4037-bf5d-543256d8222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:23.627919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d99a6550-3ab0-4037-bf5d-543256d8222d None None] MFA Rules not processed for user `f21a5d7a9a2043adb471333fd3589f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:23.629120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d99a6550-3ab0-4037-bf5d-543256d8222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:23.649210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:23.703882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 739/1474] 10.222.0.15 () {58 vars in 1064 bytes} [Mon Aug 22 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:23.711496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:23.713072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:23.816816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7053c-7237-4654-ac40-5d7c4ed30cc0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:23.896103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:23.896700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:23.896969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:23.897231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:23.899639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:23.958721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:24.013163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:24.014616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe1850-9cc8-473c-97f5-b9e624fab5ba service glance] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:24.033794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 736/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:41:26.007433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:26.007996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:26.007996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:26.009305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 740/1476] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:26.014513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472b613-d598-4ba2-a8d0-6cd1ba1ae835 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:26.014919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472b613-d598-4ba2-a8d0-6cd1ba1ae835 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:26.015058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472b613-d598-4ba2-a8d0-6cd1ba1ae835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:26.078604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4472b613-d598-4ba2-a8d0-6cd1ba1ae835 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:26.080343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4472b613-d598-4ba2-a8d0-6cd1ba1ae835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:26.174961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 737/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:26.441986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:26.443539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:26.566996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa705d-0533-4250-aa60-6c2ded0be630 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:26.618486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:26.662822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:26.663427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:26.663699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:26.663966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:26.664620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:26.666394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:41:26.666394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:41:26.666394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:41:26.667536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc19fe-d7c3-4815-974f-7aae1af4b809 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:26.685753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 741/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Aug 22 12:41:26 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:41:28.596972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:28.597413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:28.597507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:28.598893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 738/1479] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:28.604139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a241-5e65-4489-8401-b4f026b8388e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:28.609864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a241-5e65-4489-8401-b4f026b8388e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:28.609864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a241-5e65-4489-8401-b4f026b8388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:28.669098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ae25a241-5e65-4489-8401-b4f026b8388e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:28.670320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ae25a241-5e65-4489-8401-b4f026b8388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:28.766726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 742/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:29.058055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:29.059617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:29.069859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:29.202923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc851c86-d47b-4ee8-977b-cc076ae32e5e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:29.283777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:29.317082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:29.317685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:29.317953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:29.318238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:29.320132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:29.408158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:29.409740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542e381-7f14-49cc-ab8e-947f20ec177c service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:29.427696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 739/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:31.506037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:31.506663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:31.506663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:31.508010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 743/1482] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:31.513317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a01f7-6bdd-45da-b62f-8ea068334037 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:31.513762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a01f7-6bdd-45da-b62f-8ea068334037 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:31.513894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a01f7-6bdd-45da-b62f-8ea068334037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:31.579685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-da5a01f7-6bdd-45da-b62f-8ea068334037 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:31.580813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-da5a01f7-6bdd-45da-b62f-8ea068334037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:31.627495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:31.676736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 740/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:31.964679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:31.966227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:31.990622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:32.074848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac9e3-014e-493f-aaf6-f86d4dc9198c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:32.147390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:32.147985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:32.148255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:32.148520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:32.150090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:32.224517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:32.258518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:32.259944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22472605-a571-41b2-89bc-afffce91df67 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:32.278462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 744/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:34.264376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:34.264954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:34.264954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:34.266572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 741/1485] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:34.271692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea91d-01cd-487e-a062-927fa7dbfa73 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:34.272114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea91d-01cd-487e-a062-927fa7dbfa73 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:34.272222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea91d-01cd-487e-a062-927fa7dbfa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:34.340327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-357ea91d-01cd-487e-a062-927fa7dbfa73 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:34.341456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-357ea91d-01cd-487e-a062-927fa7dbfa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:34.436377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 745/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:34.724437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:34.725963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:34.829684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40595ec7-c623-4f3d-854f-b7aa59ae2731 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:34.902144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:34.903938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:34.904537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:34.904811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:34.905081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:34.906706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:35.013785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:35.015158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0b6f-a25d-432e-ac87-911c4576d92e service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:35.033954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 742/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:37.025695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:37.026262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:37.026262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:37.027545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 746/1488] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:37.033222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f129c-500f-453c-bd99-1a217a461dbe None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:37.033648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f129c-500f-453c-bd99-1a217a461dbe None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:37.033757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f129c-500f-453c-bd99-1a217a461dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:37.098078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-002f129c-500f-453c-bd99-1a217a461dbe None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:37.099301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-002f129c-500f-453c-bd99-1a217a461dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:37.150641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:37.193795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 743/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:37.482932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:37.484457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:37.520320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:37.586866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a161f-cca1-4cb3-b840-a8dc54669c30 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:37.660466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:37.661266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:37.661693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:37.662109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:37.664151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:37.744317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:37.773137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:37.774597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83520a-cf1f-42f8-8156-438db2593bf5 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:37.794132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 747/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:40.040157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:40.040718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:40.040718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:40.042038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 744/1491] 10.222.0.15 () {54 vars in 927 bytes} [Mon Aug 22 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:41:40.047421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3e2c-e9b4-45c8-843c-17f930e6abff None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:40.047929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3e2c-e9b4-45c8-843c-17f930e6abff None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:40.048056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3e2c-e9b4-45c8-843c-17f930e6abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:40.113375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-50ee3e2c-e9b4-45c8-843c-17f930e6abff None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:41:40.114610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-50ee3e2c-e9b4-45c8-843c-17f930e6abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:40.211118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 748/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Mon Aug 22 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:41:40.499185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:41:40.501425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:40.603834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152010b-3ad0-4a18-bf92-e0e153059109 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:41:40.676516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:41:40.677117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:41:40.677395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:41:40.677665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:41:40.679299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:41:40.690775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:40.794062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:41:40.795519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70f454-732d-421a-b496-69f339b26455 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:41:40.813607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 745/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:41:50.209289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=82 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:41:50.811351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=50 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.026611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.027110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.027219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.103273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:29.104461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.200803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 749/1494] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:29.208954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.209435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.209548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.283499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:29.284618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.388654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 746/1495] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:29.391194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:29.392835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.404051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f87f0-a834-41e7-a6f1-7a2fdae89f02 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:29.465330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.500208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:29.500809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.501086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.501354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.501986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:43:29.502342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:29.503357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:29.503357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:43:29.503357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:43:29.504245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:29.515500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 750/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:43:29.523649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:29.532874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c5f6e-3df5-4c65-8783-fd96586ddb23 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:29.594151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:29.632947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:29.633541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.633816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.634080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.634727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:29.636424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:29.636424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:43:29.636424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:43:29.637611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:29.743808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 747/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:43:29.747826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:29.749353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:29.783089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072123-1dd3-466e-8217-d4096d5e1adf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:29.876156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:29.876692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:29.876970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:29.877277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:29.877898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:29.878931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:29.878931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:43:29.878931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:43:29.880151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.008068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 751/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:43:29 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:43:30.012336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.013946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.076491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7d043-354e-44c3-ab41-9f403627f533 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.160944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:30.170914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.171515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.171791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.172060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.172691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.173719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.173719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:43:30.173719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:43:30.174656 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.186978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 748/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:43:30.191646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.193317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.204899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2efe-0bfe-45d1-8c75-96a163191f34 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.230636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:30.299547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.300159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.300434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.300706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.301336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.302376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.302376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:43:30.302376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:43:30.303263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df7ad-686a-44f7-84c7-040e9e478798 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.316078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 752/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:43:30.320379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.321915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.356145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252b3a4-a98e-472d-b94b-896e7cef5f4d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:30.449329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:30.449914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.450200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.450489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] PATH_INFO: `/v3/projects/a79c7f5db97d49faa4ac7d76f4d21eb1/users/3ff59557b6c7413589ebfe69aa684527/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.472689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79c7f5db97d49faa4ac7d76f4d21eb1, user_id=3ff59557b6c7413589ebfe69aa684527, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:30.473693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:30.473693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:43:30.473693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:43:30.475930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe502bd-5445-4fb6-8ea0-62ae87245d88 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:30.565528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 749/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:43:30 2022] PUT /identity/v3/projects/a79c7f5db97d49faa4ac7d76f4d21eb1/users/3ff59557b6c7413589ebfe69aa684527/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:30.578131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6098-e8f1-4dae-8663-801dc3c3281d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.578443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6098-e8f1-4dae-8663-801dc3c3281d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.578717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc6098-e8f1-4dae-8663-801dc3c3281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.635502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-12fc6098-e8f1-4dae-8663-801dc3c3281d None None] MFA Rules not processed for user `3ff59557b6c7413589ebfe69aa684527`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:30.636695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-12fc6098-e8f1-4dae-8663-801dc3c3281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.712357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 753/1502] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:43:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:30.725766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.726050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.726366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.727695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 750/1503] 10.222.0.15 () {54 vars in 964 bytes} [Mon Aug 22 12:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:43:30.732404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9cb97-9833-47eb-ad66-d5fe60c26bd6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:30.732688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9cb97-9833-47eb-ad66-d5fe60c26bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:30.732962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9cb97-9833-47eb-ad66-d5fe60c26bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:30.764457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:30.807958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fae9cb97-9833-47eb-ad66-d5fe60c26bd6 None None] MFA Rules not processed for user `384e6654dbac4182900d6326eb23182b`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:30.809140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fae9cb97-9833-47eb-ad66-d5fe60c26bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.883861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 754/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Aug 22 12:43:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:30.891495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:30.894530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:30.947441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:31.004711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ff916-a815-4ec5-832f-8d4cf56a0cac None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:31.008349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:31.008948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.009312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.009582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.011312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.102244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:31.103676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:31.121958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 751/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:43:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:43:31.166358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fa66-60f0-4010-ab29-4b44222958d1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.166754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fa66-60f0-4010-ab29-4b44222958d1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.167021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427fa66-60f0-4010-ab29-4b44222958d1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.168277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 755/1506] 10.222.0.15 () {52 vars in 830 bytes} [Mon Aug 22 12:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:43:31.171761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:31.173150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.247647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:31.276638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92071-09dc-4928-bdc6-b907ea6d01fc service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:31.281219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:31.281842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.282109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.282405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] PATH_INFO: `/v3/users/3ff59557b6c7413589ebfe69aa684527` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.284045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff59557b6c7413589ebfe69aa684527)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:31.285050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:31.285050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:43:31.285050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:43:31.286276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:31.547759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff59557b6c7413589ebfe69aa684527'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:31.548437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff59557b6c7413589ebfe69aa684527'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:31.571371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff59557b6c7413589ebfe69aa684527'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:31.641445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff59557b6c7413589ebfe69aa684527'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:31.642158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff59557b6c7413589ebfe69aa684527'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:31.663450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 752/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:43:31 2022] DELETE /identity/v3/users/3ff59557b6c7413589ebfe69aa684527 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:31.667807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.668282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.668386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.696453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:43:31.697674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.755693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 756/1508] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:43:31.765154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:31.766564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:31.842480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63789c5-bbfc-4f85-a4e7-05f09a8c72cb admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:31.845935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:31.846562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:31.846834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:31.847101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:31.856002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:31.857418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac405da3-846c-4da5-a399-429215db8973 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:31.866557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 753/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:43:32.381738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:43:32.383187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:43:32.394989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae326-ed18-4c04-abf3-1a8a018edb9f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:43:32.400122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:43:32.400740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:43:32.401004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:43:32.401269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] PATH_INFO: `/v3/projects/a79c7f5db97d49faa4ac7d76f4d21eb1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:43:32.404790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79c7f5db97d49faa4ac7d76f4d21eb1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:43:32.404790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:43:32.404790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:43:32.404790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:43:32.404790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:43:32.523580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:32.526979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79c7f5db97d49faa4ac7d76f4d21eb1', 'request_id': 'req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.633428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79c7f5db97d49faa4ac7d76f4d21eb1', 'request_id': 'req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.646980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79c7f5db97d49faa4ac7d76f4d21eb1', 'request_id': 'req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.658139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] The token cache is being invalidate because project a79c7f5db97d49faa4ac7d76f4d21eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:43:32.659149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.660256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2e05645c-8bb1-4e0f-9b61-1e9fd1d1dc81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:43:32.667546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 757/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:43:32 2022] DELETE /identity/v3/projects/a79c7f5db97d49faa4ac7d76f4d21eb1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:43:41.862546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:43:42.660468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:44:57.361343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:57.361905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:57.361905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:57.363447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:44:57.368408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564688e1-1003-4bb2-94d7-293ea6702d85 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:57.368848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564688e1-1003-4bb2-94d7-293ea6702d85 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:57.368945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564688e1-1003-4bb2-94d7-293ea6702d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:57.417301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-564688e1-1003-4bb2-94d7-293ea6702d85 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:44:57.418547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-564688e1-1003-4bb2-94d7-293ea6702d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:44:57.476345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:44:57.629609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:44:57.631404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:44:57.732752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439d668-28aa-43a3-a981-85e62a84c8c3 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:44:57.738224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:44:57.738824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:57.739102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:57.739374 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:57.747829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:44:57.749398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b934a3-cc3d-4993-83d3-a28f70287ece service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:44:57.759249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 755/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:44:58.593389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc743-eaab-42c6-b682-8508b696b868 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:58.593962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc743-eaab-42c6-b682-8508b696b868 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:58.593962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc743-eaab-42c6-b682-8508b696b868 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:58.595248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:44:58.599963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b75d3-3ae1-476b-8a08-24a7dae19614 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:58.600403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b75d3-3ae1-476b-8a08-24a7dae19614 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:58.600513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b75d3-3ae1-476b-8a08-24a7dae19614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:58.619783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-718b75d3-3ae1-476b-8a08-24a7dae19614 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:44:58.620957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-718b75d3-3ae1-476b-8a08-24a7dae19614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:44:58.628639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:44:58.780502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc743-eaab-42c6-b682-8508b696b868 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:44:58.794560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc743-eaab-42c6-b682-8508b696b868 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:44:58.799907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:44:58.800492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:58.800766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:58.801034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:58.809014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:44:58.810612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749a4b-682d-45b3-82b0-befa137db79b service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:44:58.820267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 760/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:44:59.205921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f267-18d6-4cb8-bd88-7a9812cdfc7a None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:59.206131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f267-18d6-4cb8-bd88-7a9812cdfc7a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:59.206391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f267-18d6-4cb8-bd88-7a9812cdfc7a None None] PATH_INFO: `/v3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:59.207676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 757/1517] 10.222.0.42 () {54 vars in 925 bytes} [Mon Aug 22 12:44:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:44:59.217497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083bd-2859-4a4f-9153-d9eec43e0e5b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:44:59.217786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083bd-2859-4a4f-9153-d9eec43e0e5b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:44:59.218061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083bd-2859-4a4f-9153-d9eec43e0e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:44:59.277951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d2a083bd-2859-4a4f-9153-d9eec43e0e5b None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:44:59.279200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d2a083bd-2859-4a4f-9153-d9eec43e0e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:44:59.353245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 761/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Aug 22 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:08.574009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a98-9a52-40aa-a5ff-e8541079516a None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:08.574573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a98-9a52-40aa-a5ff-e8541079516a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:08.574573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580a98-9a52-40aa-a5ff-e8541079516a None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:08.576456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 758/1519] 10.222.0.15 () {54 vars in 961 bytes} [Mon Aug 22 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:08.581712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954841a-df38-4d2b-b42d-b5f718cf78e1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:08.582150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954841a-df38-4d2b-b42d-b5f718cf78e1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:08.582293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954841a-df38-4d2b-b42d-b5f718cf78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:08.601292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2954841a-df38-4d2b-b42d-b5f718cf78e1 None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:08.602755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2954841a-df38-4d2b-b42d-b5f718cf78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:08.611108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 762/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Aug 22 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:08.614904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=49 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:08.618317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580a98-9a52-40aa-a5ff-e8541079516a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:08.632240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580a98-9a52-40aa-a5ff-e8541079516a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:08.637271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:08.638422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:08.638702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:08.638981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:08.647718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:08.649332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ed81-a622-4878-bb9b-0593b1474c4f service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:08.658995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 759/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:45:10.074153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7909-4791-43c9-ad42-8914e772ea95 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.074763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7909-4791-43c9-ad42-8914e772ea95 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.074763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7909-4791-43c9-ad42-8914e772ea95 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.076073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:10.080924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5412c-8823-46f4-9430-e72931d277c4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.081330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5412c-8823-46f4-9430-e72931d277c4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.081528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5412c-8823-46f4-9430-e72931d277c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.100894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5fa5412c-8823-46f4-9430-e72931d277c4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:10.102383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5fa5412c-8823-46f4-9430-e72931d277c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:10.110707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:10.264065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7909-4791-43c9-ad42-8914e772ea95 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:10.279067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7909-4791-43c9-ad42-8914e772ea95 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:10.284625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:10.285227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:10.285522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:10.285884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:10.295091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:10.296676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79c38c-bdb4-436c-8785-65d044714b5e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:10.300833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:10.307303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 764/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:11.142318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2e70-d590-49d1-9dcb-67ab9e7857bb None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:11.142904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2e70-d590-49d1-9dcb-67ab9e7857bb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:11.142904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f2e70-d590-49d1-9dcb-67ab9e7857bb None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:11.144228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:11.148969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42630066-1513-4180-84c1-dad81822c09f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:11.149436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42630066-1513-4180-84c1-dad81822c09f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:11.149545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42630066-1513-4180-84c1-dad81822c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:11.169222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-42630066-1513-4180-84c1-dad81822c09f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:11.170430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-42630066-1513-4180-84c1-dad81822c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:11.178101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:11.330034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f2e70-d590-49d1-9dcb-67ab9e7857bb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:11.344482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f2e70-d590-49d1-9dcb-67ab9e7857bb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:11.349918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:11.350533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:11.350807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:11.351074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:11.359836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:11.361440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2889-cdb5-4658-a8d3-4591301afd8c service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:11.370772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 762/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:15.178797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:15.179440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:15.179440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:15.180700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:15.186698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28e847-d073-4adb-8fff-833f5afd86cd None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:15.187134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28e847-d073-4adb-8fff-833f5afd86cd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:15.187241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28e847-d073-4adb-8fff-833f5afd86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:15.208249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9d28e847-d073-4adb-8fff-833f5afd86cd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:15.209469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9d28e847-d073-4adb-8fff-833f5afd86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:15.217455 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:15.505137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:15.506923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:15.563564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a536-de96-4b48-bcf4-6a621800685e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:15.567182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:15.567779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:15.568057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:15.568332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:15.577185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:15.578644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12695692-df85-4aae-9286-1035d1cd952f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:15.588091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 767/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:17.510160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1a54-d0fb-4f2a-aac0-e9b2e3eb4d9c None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:17.510705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1a54-d0fb-4f2a-aac0-e9b2e3eb4d9c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:17.510705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c1a54-d0fb-4f2a-aac0-e9b2e3eb4d9c None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:17.512056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:17.517471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e122-0fda-4857-a65f-e52dd81ff42b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:17.517916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e122-0fda-4857-a65f-e52dd81ff42b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:17.518022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e122-0fda-4857-a65f-e52dd81ff42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:17.536806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d807e122-0fda-4857-a65f-e52dd81ff42b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:17.538032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d807e122-0fda-4857-a65f-e52dd81ff42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:17.546206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:17.829318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c1a54-d0fb-4f2a-aac0-e9b2e3eb4d9c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:17.839940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c1a54-d0fb-4f2a-aac0-e9b2e3eb4d9c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:17.844045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:17.844642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:17.844915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:17.845180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:17.854174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:17.855620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9838934-04a6-438b-a09c-d470c6961106 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:17.865384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 765/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:21.204284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.204866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.204866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.206171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:21.211346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68cb62-02ee-455b-b955-0975b39c57db None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.211789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68cb62-02ee-455b-b955-0975b39c57db None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.211900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68cb62-02ee-455b-b955-0975b39c57db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.231869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bf68cb62-02ee-455b-b955-0975b39c57db None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:21.233053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bf68cb62-02ee-455b-b955-0975b39c57db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:21.240784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:21.796982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:21.798665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:21.854845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd915ba8-8eba-4c00-b7bc-9c8a461189c8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:21.858328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:21.858913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:21.859186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:21.859457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:21.868050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:21.869448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f36f29-71f3-4fda-a9ab-b42850f71f46 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:21.878560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 770/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:23.809358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:23.809903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:23.809903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:23.811286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:45:23.816651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf673f-255b-4559-b126-8100559d4285 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:23.817085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf673f-255b-4559-b126-8100559d4285 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:23.817187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf673f-255b-4559-b126-8100559d4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:23.836298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cdaf673f-255b-4559-b126-8100559d4285 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:45:23.837490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cdaf673f-255b-4559-b126-8100559d4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:23.845858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:45:24.395196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:45:24.396837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:45:24.410084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c9e62-28cf-48ed-8175-d53cf2b1c40f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:45:24.413599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:45:24.414208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:45:24.414486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:45:24.414755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:45:24.425219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:45:24.426677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8349b-39e5-43da-9204-8e816b659a7e service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:45:24.435896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 768/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:45:33.831116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=62 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:45:34.431836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=33 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:46.819177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0810b-a60d-46d6-82d3-838929c54589 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.819835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0810b-a60d-46d6-82d3-838929c54589 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.819835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0810b-a60d-46d6-82d3-838929c54589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.843057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-83e0810b-a60d-46d6-82d3-838929c54589 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:46.844824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-83e0810b-a60d-46d6-82d3-838929c54589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:46.857151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 772/1540] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:46.857430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ddf5-52e4-49e4-b9d4-c00234b70669 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.858511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ddf5-52e4-49e4-b9d4-c00234b70669 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.859109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ddf5-52e4-49e4-b9d4-c00234b70669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.871844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02273eb-970e-4e0c-b441-8f741973bccc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.872023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02273eb-970e-4e0c-b441-8f741973bccc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.872252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02273eb-970e-4e0c-b441-8f741973bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.886994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7e80ddf5-52e4-49e4-b9d4-c00234b70669 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:46.888952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7e80ddf5-52e4-49e4-b9d4-c00234b70669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:46.900283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d02273eb-970e-4e0c-b441-8f741973bccc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:46.901551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d02273eb-970e-4e0c-b441-8f741973bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:46.908335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 769/1541] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:46:46.911225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.911515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.911783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.924658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 773/1542] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:46:46.926151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc3d5c-298d-4481-9df1-d8780dc00f7f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.931585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc3d5c-298d-4481-9df1-d8780dc00f7f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.931928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc3d5c-298d-4481-9df1-d8780dc00f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.956448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c9dc3d5c-298d-4481-9df1-d8780dc00f7f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:46.957683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c9dc3d5c-298d-4481-9df1-d8780dc00f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:46.962441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:46.963700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:46.974354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 770/1543] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:46.975506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:46.985238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 774/1544] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:46.986797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79a2c-153e-4e42-ac13-2505a4951248 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.987081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fa9df-ded5-4db3-975c-f79d25174bd9 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:46.987207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79a2c-153e-4e42-ac13-2505a4951248 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.987393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f79a2c-153e-4e42-ac13-2505a4951248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.992195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:46.992832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:46.993117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:46.993390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:46.994057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:46.994392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:46.995545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:46.995545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:46:46.995545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:46:46.996538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.010415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 771/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.011345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.022205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604607-970d-4130-ba63-bd39e570ff6a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.027070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.027690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.027966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.028090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-99f79a2c-153e-4e42-ac13-2505a4951248 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.028289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.028875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.029176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.029297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-99f79a2c-153e-4e42-ac13-2505a4951248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.030933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.057007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 772/1546] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.058120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.068721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 775/1547] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.069724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5264-dfc4-44c5-9683-578062732eda admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.070241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.070534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.070811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.074927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.075533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.075817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.076097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.076717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.079247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.107213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.108435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.118240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 776/1548] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.121235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.136717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3b67-8fee-47ed-a7b6-e4d081739b64 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.142616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.143246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.143524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.143799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.144575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.145609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:47.145609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:46:47.145609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:46:47.146846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b8818-d577-4907-a2a2-34fec2b85ac9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.194120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 773/1549] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.194990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.247680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 777/1550] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.247680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93986-7ead-482e-ac3d-66c1bf4d6488 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.247680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93986-7ead-482e-ac3d-66c1bf4d6488 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.247680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93986-7ead-482e-ac3d-66c1bf4d6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.263730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eee303-48d9-4380-ab8c-ff743bf0652c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.265977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-61b93986-7ead-482e-ac3d-66c1bf4d6488 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.267202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-61b93986-7ead-482e-ac3d-66c1bf4d6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.329931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.330567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.330844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.331113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.331747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.332043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.333633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dc5a3-fba7-41a7-960c-fa6fe22e7a31 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.339455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 778/1551] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.341029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.341457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.342089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.352139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 774/1552] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.352139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2635-5585-4285-a6c4-e956ff7327b9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.352139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2635-5585-4285-a6c4-e956ff7327b9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.352139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2635-5585-4285-a6c4-e956ff7327b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.366940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-775f2635-5585-4285-a6c4-e956ff7327b9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.367600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.368140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-775f2635-5585-4285-a6c4-e956ff7327b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.369328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.376559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 775/1553] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.377732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292dcd-cd4a-4d08-9e6e-e77d8dec6827 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.378013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292dcd-cd4a-4d08-9e6e-e77d8dec6827 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.378315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12292dcd-cd4a-4d08-9e6e-e77d8dec6827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.383603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 779/1554] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.384651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.394216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f13362-7e46-4391-a9e5-85c8c3d6c4db None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.399058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.399655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.399928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.400194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.400801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.402296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-12292dcd-cd4a-4d08-9e6e-e77d8dec6827 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.402738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.403474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-12292dcd-cd4a-4d08-9e6e-e77d8dec6827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.412073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 776/1555] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.413757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.414033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.414343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.433541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.434735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.443111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 777/1556] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.443903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.453017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3564f-965b-4428-bd29-917a030c2929 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.461545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.462442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.462819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.463141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.463929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.465098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:47.465098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:46:47.465098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:46:47.466663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f18040-0881-4c73-a621-c96d26ed1967 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.477780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:47.486215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 780/1557] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.486215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.494619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5257e-b494-4b17-8bd5-07f38bc0ec8c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.499216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.499787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.500066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.500403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.501031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.501332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.502971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.514682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 781/1558] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.515350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.524533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c6ba5-35c1-4e5d-b286-bca1d4da1ea5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.530277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.530839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.531115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.531384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.532490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.534349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a68f-3f71-4305-a18d-b297492dc60d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.591754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 778/1559] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.593144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967856fa-0541-4ad5-ae84-3281072ca926 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.593463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967856fa-0541-4ad5-ae84-3281072ca926 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.593739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967856fa-0541-4ad5-ae84-3281072ca926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.613735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-967856fa-0541-4ad5-ae84-3281072ca926 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.614970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-967856fa-0541-4ad5-ae84-3281072ca926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.622732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 779/1560] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.623846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78f0b-e503-4aa4-9289-57e38745130f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.624124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78f0b-e503-4aa4-9289-57e38745130f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.624396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78f0b-e503-4aa4-9289-57e38745130f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.640182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 782/1561] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.645787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.645787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.645787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.646267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-08f78f0b-e503-4aa4-9289-57e38745130f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.646267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-08f78f0b-e503-4aa4-9289-57e38745130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.662901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.664172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.709115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 780/1562] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.710498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.711080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.711080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.714606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:47.731173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:47.732373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:47.732748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 783/1563] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.733577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.741252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 781/1564] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:47.747479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.747612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797d02-c686-45c7-b903-b279255b7edd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.750417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.751022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.751305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.751581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.751721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d60d-7ed7-4830-b611-b7f772649597 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.752218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.753820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.756528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.757115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.757390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.757678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.758303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.760205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.763839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 784/1565] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:47.764633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.775492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8e6bb-908a-4a73-8875-80191ac4ae1a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.780131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.782281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.782281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.782281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.782575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.784000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.794436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 785/1566] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:47.795216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.805167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf56c1-653a-400e-bcaa-cd4070830459 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.809698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.810415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.810537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.810821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.811434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.811737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.813300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.824989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 786/1567] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.828059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.835379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3620d-d043-46c3-9a12-2f45357c62ff admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.839920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.840472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.840751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.841023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.841623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.843495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.922861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 787/1568] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.923698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.933105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c16c2-74a1-4ffa-96af-dbcf8a9040f8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.937676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.938274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.942831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.942831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.942831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.942831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.942831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.952954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 788/1569] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.954247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.963567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80853d42-bcdb-4b32-bba2-d2fb10825a6e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:47.968257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:47.968831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:47.969731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:47.970010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:47.973776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 782/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:47.974278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:47.974278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:47.974470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:47.974573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:47.984916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 789/1571] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:47.990148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.000544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c072e1-5470-4977-800b-6cb69a44b2f4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.048664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de244a5-e3b8-4ea3-9f8a-6789836a6cdc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.053335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.056821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.056821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.056821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.056821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:48.056821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.057282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.059893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.060505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.060806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.061106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.061744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.063396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.068496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 783/1572] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:48.069307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.073825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 790/1573] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:48.074799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.079842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdff0e-63d6-460f-ad0d-a42728b153c9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.084580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.085309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.085452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.085576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f850d-bdca-491a-bda1-54215feb5852 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.085726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.086397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.088000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.090145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.090760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.091039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.091314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.091926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.093800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.099033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 784/1574] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:48.099822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.109949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5973-6c71-4c1a-91a6-903c755a65df admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.114792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.115467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.115693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.115964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.116594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.118160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.128224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 785/1575] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:48.129106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.138654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d2d96-9095-4e34-84ad-06678809f874 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.144249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.145100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.145224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.145439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.146038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.147939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.198934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 791/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.200018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.243881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:48.261047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06f95-aa68-4cb3-b5ec-246fd2929b21 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.265948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.267224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.267409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.267682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.268310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.270362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.274145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 786/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.275047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.285534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:48.341380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7dc92-8f5f-4dfc-9d95-0371e4b0ae2c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.346190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.346818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.347098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.347369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.348009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.349923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.351846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 792/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.355543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.363189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4198dc-cf75-4462-a7d6-c0ccf40ea632 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.368261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.368913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.369190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.369466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] PATH_INFO: `/v3/projects/8fff07d9bde345e2aad41598a71eef12/users/0925c914747e49e3b51bdb173ec6bae1/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.385525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fff07d9bde345e2aad41598a71eef12, user_id=0925c914747e49e3b51bdb173ec6bae1, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.386588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:48.386588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:46:48.386588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:46:48.388547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.454984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 793/1579] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:48 2022] PUT /identity/v3/projects/8fff07d9bde345e2aad41598a71eef12/users/0925c914747e49e3b51bdb173ec6bae1/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:48.455721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.457113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 787/1580] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.461084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.517901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e797b-6231-44c6-bfee-99cebcbe311c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.531495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc307b4-4288-4570-a13f-2a708dcf5f60 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.536252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.536989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.537272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.537550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] PATH_INFO: `/v3/projects/3109ccf16c2146d1b8a1413cf7e0a851/users/4938373d551a46bcbced348d85f9d968/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.551453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3109ccf16c2146d1b8a1413cf7e0a851, user_id=4938373d551a46bcbced348d85f9d968, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.554120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.572999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.573613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.573895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.574165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.574805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.576686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.677300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 788/1581] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:48 2022] PUT /identity/v3/projects/3109ccf16c2146d1b8a1413cf7e0a851/users/4938373d551a46bcbced348d85f9d968/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:48.678043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.701667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 794/1582] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.702956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.742740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73ea9-76bd-4238-9619-0dd61132d8f5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.748007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:48.763460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:48.768394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c81b-adbf-4e74-acaf-817259480e81 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.773072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.773677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.773955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.774255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.774872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.777115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.799390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.799991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.800268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.800536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.801160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.802775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.812621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 789/1583] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:48.814064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.823322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370000-00ba-43f1-8138-81ea5555f512 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.827809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.828349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.828623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.828893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.829480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.831419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c4bfb-cb6f-46a6-9997-58e25669064f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.869711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 795/1584] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.869711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.877585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1cd81-3da8-4fa5-a54d-fa2b1a6009e0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.882170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.883002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.883454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.884048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.884681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.886300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.896784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 796/1585] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:48.897531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:48.908313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441d2e-024c-4b4f-94de-8eafdb941505 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:48.913024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:48.913666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.913970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.914264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.914883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:48.916843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daeac-478d-4c0b-bcce-26108e753660 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:48.941187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 790/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:48.942528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:48.942808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:48.943075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:48.971527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] MFA Rules not processed for user `0925c914747e49e3b51bdb173ec6bae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:48.972769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:49.014620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 797/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:49.015879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.016166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.016447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.038647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 791/1588] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:49.040723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.045279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] MFA Rules not processed for user `4938373d551a46bcbced348d85f9d968`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:49.046535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:49.051025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477d81c-4b6a-4618-82bc-5a8c50fff49c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.055858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.056250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.056521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.056783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.057395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.059355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.113835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 798/1589] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:49.114740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.125650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef3f4-e50c-49de-9d7d-75d10717ba5e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.130351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.130993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.131263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.131528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] PATH_INFO: `/v3/projects/30bf0498eabd4d9988b2084c0b082fad/users/9767d18cf0944f16b45fff4214128c1a/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.145822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bf0498eabd4d9988b2084c0b082fad, user_id=9767d18cf0944f16b45fff4214128c1a, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.148467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd2303-9e79-42e0-b4c3-2137c86d4e1b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.155888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 792/1590] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:49 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:49.155888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.164045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6408c2-d260-46d8-a2e6-8200def46967 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.168631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.169201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.169478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.169748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.170478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.172042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.183705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 793/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.183705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.192818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20def-b2fd-4217-a5c8-96d51960e609 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.197415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.198008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.198317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.198590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.199184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.200705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.210847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 794/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.211601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.220705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389810f-f8d4-4960-b6d3-236043cc88be admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.226344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.226344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.226608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.226705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.227311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.228821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.239001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 795/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.239754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.249032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd9695-a889-4717-a329-94f41faa4361 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.249372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 799/1594] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:49 2022] PUT /identity/v3/projects/30bf0498eabd4d9988b2084c0b082fad/users/9767d18cf0944f16b45fff4214128c1a/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:49.251263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d21f90-0f47-4937-b87f-d26c45c35337 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.251547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d21f90-0f47-4937-b87f-d26c45c35337 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.251928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d21f90-0f47-4937-b87f-d26c45c35337 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.253725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 800/1595] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 12:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:46:49.254456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d21f90-0f47-4937-b87f-d26c45c35337 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.301006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.312609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d21f90-0f47-4937-b87f-d26c45c35337 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.316742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.317342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.317618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.317884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.318643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.319259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.319535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.319810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.320441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.322325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.333163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 796/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.334084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.337978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.350679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ec9bf-28cc-4ffb-bafa-e745facfe64f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.356296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.361305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.361305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.361305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.361305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.361305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.373500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 797/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.374586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.382045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.383082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.385477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33474828-182d-457a-be1c-f263fda7afb8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.390054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.390756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.391567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.391835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.392450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.392548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 801/1598] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:49.393244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.395775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.403684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19ee15-c0e2-42f0-b234-cd374402e6cb service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.405697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 798/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.407169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.409171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.409836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.410123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.410439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] PATH_INFO: `/v3/projects/d2e81d9adcb6477aa19c0cbacca01351/users/5b1db5be49014d2cba63cdee9df5b1d0/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.418100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394244a-95f4-4002-926d-c4aadf0bad15 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.423581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.424293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.424772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.425079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.425815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.426775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e81d9adcb6477aa19c0cbacca01351, user_id=5b1db5be49014d2cba63cdee9df5b1d0, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.427676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cb2d8-41ac-4e54-8105-518631ee1e07 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.429491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.438877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 799/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.440457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c3c-4722-45fb-980e-a9d5219f2fa3 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.446629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c3c-4722-45fb-980e-a9d5219f2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.446629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95951c3c-4722-45fb-980e-a9d5219f2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.460834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-95951c3c-4722-45fb-980e-a9d5219f2fa3 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:49.462054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-95951c3c-4722-45fb-980e-a9d5219f2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:49.475752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 800/1601] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:49.475752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.475752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.475752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.514765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:49.516549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:49.529419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 802/1602] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:49 2022] PUT /identity/v3/projects/d2e81d9adcb6477aa19c0cbacca01351/users/5b1db5be49014d2cba63cdee9df5b1d0/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:49.534361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.599691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa10e-d7cb-410b-8d1a-36262bc64228 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.600622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 801/1603] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 12:46:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:49.601247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.605191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.605800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.606074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.606372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.607066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.608711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.613022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296034f-cb05-4c69-a402-86ce0db0475f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.618364 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.618970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.619248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.619518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.620156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.621753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.627058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 803/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.627058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.633244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 802/1605] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:49.634098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.637929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a09264-6434-4f5a-b540-85b13050ec95 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.642660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.647571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.647571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.647571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] PATH_INFO: `/v3/projects/5574355e5db64af7bf6a0469c29f5569/users/56a8835b7a764c65820758eaf7accbbe/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.648003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f06ec3-2a7b-4b09-8814-e6a493ec2bbc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.657299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.658284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.658658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.659012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] PATH_INFO: `/v3/projects/97408eeab80e45f9a27c405c23038f8c/users/36a40c9d61174c38b007ba0a30fc95c3/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.664368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5574355e5db64af7bf6a0469c29f5569, user_id=56a8835b7a764c65820758eaf7accbbe, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.667141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.677795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97408eeab80e45f9a27c405c23038f8c, user_id=36a40c9d61174c38b007ba0a30fc95c3, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.680622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5307f-da17-454b-b693-89fdc1e905a0 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.752231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 804/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:49 2022] PUT /identity/v3/projects/5574355e5db64af7bf6a0469c29f5569/users/56a8835b7a764c65820758eaf7accbbe/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:49.752993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.755860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 803/1607] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:49 2022] PUT /identity/v3/projects/97408eeab80e45f9a27c405c23038f8c/users/36a40c9d61174c38b007ba0a30fc95c3/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:49.757320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.757611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.757899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.777487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:49.778810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:49.816265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb55b5-eb90-4b4d-8d51-1e65ad1b0443 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.820141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.820489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.820753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.821189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.821609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.847693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 804/1608] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:49.847693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.848650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:49.895289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.896805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:49.907677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 805/1609] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:49.908672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:49.918540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd12a-6e99-4e1b-94ee-cf771cef0ba6 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.924468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.925122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.925398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.925559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0d05d-9607-4a52-bd61-2b352f08c4d0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:49.925677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] PATH_INFO: `/v3/projects/2974de9c06c940fe97436b66d66a8208/users/6afea10ed5b5466aa24f922a296edc39/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.933948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:49.935069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:49.935352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:49.935675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:49.943048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2974de9c06c940fe97436b66d66a8208, user_id=6afea10ed5b5466aa24f922a296edc39, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:49.945810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16423ed9-7a7f-4f74-b50d-a0c0fb4b672c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.004212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.005747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.017841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 805/1610] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:50.018900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.020234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 806/1611] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:49 2022] PUT /identity/v3/projects/2974de9c06c940fe97436b66d66a8208/users/6afea10ed5b5466aa24f922a296edc39/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:50.023463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02a36-0b71-459a-af8b-cf9fddd21c5e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.023463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02a36-0b71-459a-af8b-cf9fddd21c5e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.023463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02a36-0b71-459a-af8b-cf9fddd21c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.033995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7793cf5-dc0a-4364-888b-941dec50ad65 service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.042358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5ef02a36-0b71-459a-af8b-cf9fddd21c5e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.043568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5ef02a36-0b71-459a-af8b-cf9fddd21c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.109641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.111109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.111241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.111510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] PATH_INFO: `/v3/projects/d285f70190b04d64a240f7fcf648b7dd/users/a188768395324f928027ea6f72e7f9de/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.122826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 807/1612] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:50.122826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.122826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.122826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.136256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d285f70190b04d64a240f7fcf648b7dd, user_id=a188768395324f928027ea6f72e7f9de, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.140117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b0ff-40f0-4fd2-bdeb-5a0d2877448e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.166415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.167913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.179515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 808/1613] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:50.179515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.229951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 806/1614] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:50 2022] PUT /identity/v3/projects/d285f70190b04d64a240f7fcf648b7dd/users/a188768395324f928027ea6f72e7f9de/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:50.232085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.232538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.232889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.274851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.309724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] MFA Rules not processed for user `6afea10ed5b5466aa24f922a296edc39`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.312495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.339502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0840c-46a8-4736-870c-b5e75e9999be None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.397238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.405210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.409179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 807/1615] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:50.409179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.409452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.409452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.409452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.418819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f91a-1b7c-4f1b-b4c3-03fa0d654d9c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.423528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.424384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.424707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.425035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.490947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.492531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.499168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.501826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77346393-4397-4cb4-b80a-d326e426e6a5 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.504996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 809/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:50.507260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.509114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.522337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8427ec-7611-48cc-92b8-62ad5b99c14a service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.528338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.529364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.529862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.530317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.532430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 808/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:50.534265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eed8d-ada4-4d0d-973e-aa764513bc67 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.534397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eed8d-ada4-4d0d-973e-aa764513bc67 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.534724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eed8d-ada4-4d0d-973e-aa764513bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.564017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.565467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85a743-8c54-4120-98a6-adf67916e5d1 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.576121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0a3eed8d-ada4-4d0d-973e-aa764513bc67 None None] MFA Rules not processed for user `a188768395324f928027ea6f72e7f9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.577854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0a3eed8d-ada4-4d0d-973e-aa764513bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.582551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 810/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:50.584269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea093a7-ec89-4a3f-88f1-b65e7d790314 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.584551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea093a7-ec89-4a3f-88f1-b65e7d790314 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.584824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea093a7-ec89-4a3f-88f1-b65e7d790314 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.586838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 811/1619] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:46:50.587652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea093a7-ec89-4a3f-88f1-b65e7d790314 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.610493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea093a7-ec89-4a3f-88f1-b65e7d790314 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.616676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.617399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.617752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.618167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.618929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.621688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.656403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 809/1620] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:50.658295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8e624-c84f-480e-9d89-28a74bc17dfd None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.658578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8e624-c84f-480e-9d89-28a74bc17dfd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.658903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8e624-c84f-480e-9d89-28a74bc17dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.679640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-27b8e624-c84f-480e-9d89-28a74bc17dfd None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.680960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-27b8e624-c84f-480e-9d89-28a74bc17dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.691418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:50.757853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 810/1621] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:50.759648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1721e-888c-43df-bb5a-9f2edd5038dc None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.760006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1721e-888c-43df-bb5a-9f2edd5038dc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.760356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1721e-888c-43df-bb5a-9f2edd5038dc None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.762144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 811/1622] 10.222.0.15 () {54 vars in 962 bytes} [Mon Aug 22 12:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:46:50.771295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.771588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.771857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.791870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:50.794630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:50.809736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 812/1623] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:46:50.810740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.812700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 812/1624] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:50.815685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:50.911779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64fc3-af91-499e-bd8c-df81a6710b84 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.936371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ed7ca-5c8a-4338-b366-3e92fe6e5c84 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:50.942892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.944559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.946085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.947271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:50.948779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:50.956297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:50.977632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:50.978278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:50.978554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:50.978825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.058367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.060001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.061610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 813/1625] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:46:50 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:46:51.062411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.072112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 813/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:51.073960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.084622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:51.089228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413a6b-defa-4531-92a7-7066e806c34a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.098366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.099139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.099528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.099807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.115949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844705f-53e3-444a-b227-d40909f79e38 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.120832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.121560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.121853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.122195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.122917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.124582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.147460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 814/1627] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:51.151307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.162780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a42c-26d9-42c4-9a25-699fa18384df admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.166826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:51.170707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.171627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.172353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.172784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] PATH_INFO: `/v3/projects/2a6266cbb736488299ab5a3b8b0d6271/users/cf03802e4d674a3c831cdfceafb94a7f/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.181136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.183148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.193906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6266cbb736488299ab5a3b8b0d6271, user_id=cf03802e4d674a3c831cdfceafb94a7f, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.195420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 814/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:51.215312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.299523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 815/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:51 2022] PUT /identity/v3/projects/2a6266cbb736488299ab5a3b8b0d6271/users/cf03802e4d674a3c831cdfceafb94a7f/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:51.300877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.329082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b326-3752-44de-81eb-cd98a7fb4b8e service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.489074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.489706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.489985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.490427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.491139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.493743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20990e-7356-42a9-9e0f-fbbc67151d75 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.509933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 815/1630] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:46:51.515141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.527912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fbdd5-3d24-4f10-beed-bbafc34fc0f3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.542880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.543551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.543936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.544356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] PATH_INFO: `/v3/projects/2a6266cbb736488299ab5a3b8b0d6271/users/cf03802e4d674a3c831cdfceafb94a7f/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.546601 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6266cbb736488299ab5a3b8b0d6271, user_id=cf03802e4d674a3c831cdfceafb94a7f, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.550268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca94b6-a3b5-4df6-99bd-ba028646c84e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.568285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 816/1631] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:46:51 2022] PUT /identity/v3/projects/2a6266cbb736488299ab5a3b8b0d6271/users/cf03802e4d674a3c831cdfceafb94a7f/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:51.579716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.580007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.580365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.589768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a976f1-00ea-4009-a0db-346e9714aefc None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.590055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a976f1-00ea-4009-a0db-346e9714aefc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.590388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a976f1-00ea-4009-a0db-346e9714aefc None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.592086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 817/1632] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 12:46:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:46:51.600310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.602489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.602962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.627430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] MFA Rules not processed for user `cf03802e4d674a3c831cdfceafb94a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:51.629541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:51.632715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:51.634556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:51.727761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 818/1633] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:51.743386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:51.751375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 816/1634] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:46:51.808456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235644-d0bd-44d5-9e7b-d32a58752824 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:51.812118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:51.812830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:51.813175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:51.813523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:51.824531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:51.826001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:51.846383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 819/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:46:52.035811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:52.049756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043bd5-c260-44e1-9d74-eb44e689ff87 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:52.055532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:52.056436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:52.056964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:52.058592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:52.072686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:52.078024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:52.094583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 817/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:53.691188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:53.705653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8c1c5-7d5c-4870-8f0d-e22a8f1c2570 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:53.725881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf03802e4d674a3c831cdfceafb94a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6266cbb736488299ab5a3b8b0d6271', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:53.725881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:53.725881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:53.726597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:53.726597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:53.726597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:53.726597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:53.761020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:53.769004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 820/1637] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:53.774125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632bb0-e509-4748-84f3-3db5103d2b79 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:53.779166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf03802e4d674a3c831cdfceafb94a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6266cbb736488299ab5a3b8b0d6271', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:53.780014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:53.780651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:53.781047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:53.782502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:53.784661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:53.933424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:53.941787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 818/1638] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:46:53 2022] POST /identity/v3/projects => generated 355 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:46:53.948141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ea0b-de46-4df3-b11e-e593d27da133 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:53.996781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:54.051161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf03802e4d674a3c831cdfceafb94a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6266cbb736488299ab5a3b8b0d6271', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:54.052092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:54.052380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:54.052842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:54.053440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:46:54.053938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:54.057537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:54.086883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 821/1639] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:46:54.185988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:54.199459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f01-ce2c-4c0d-94c0-5374d6974e8d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:54.218795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf03802e4d674a3c831cdfceafb94a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a6266cbb736488299ab5a3b8b0d6271', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:54.219599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:54.219991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:54.220369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] PATH_INFO: `/v3/projects/4b6862eceb464c72ae4974f658dd1bbe` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:54.221681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b6862eceb464c72ae4974f658dd1bbe)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:54.223795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:54.427457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:54.453974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6862eceb464c72ae4974f658dd1bbe', 'request_id': 'req-29c4c286-0f5e-422a-952e-1dda99865b0d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:54.610065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6862eceb464c72ae4974f658dd1bbe', 'request_id': 'req-29c4c286-0f5e-422a-952e-1dda99865b0d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:54.621637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6862eceb464c72ae4974f658dd1bbe', 'request_id': 'req-29c4c286-0f5e-422a-952e-1dda99865b0d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:54.643656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] The token cache is being invalidate because project 4b6862eceb464c72ae4974f658dd1bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:46:54.643997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:54.645396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:54.650230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 819/1640] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:46:54 2022] DELETE /identity/v3/projects/4b6862eceb464c72ae4974f658dd1bbe => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:55.868121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:55.880513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:55.882835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:55.885338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:56.118306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f211-7a4f-485f-aada-590bbcd2dbe8 tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:56.130703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:56.131336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:56.131616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:56.135110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] PATH_INFO: `/v3/users/6afea10ed5b5466aa24f922a296edc39` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:56.137253 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afea10ed5b5466aa24f922a296edc39)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:56.141995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:56.149541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4c286-0f5e-422a-952e-1dda99865b0d tempest-VolumeQuotaClassesTest-1613617933 tempest-VolumeQuotaClassesTest-1613617933-project-admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:56.175573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:56.177707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:56.180179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:56.181962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] PATH_INFO: `/v3/users/0925c914747e49e3b51bdb173ec6bae1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:56.185982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0925c914747e49e3b51bdb173ec6bae1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:56.188461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: WARNING py.warnings [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:56.188461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: warnings.warn(msg) Aug 22 12:46:56.188461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: Aug 22 12:46:56.197787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:56.456142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afea10ed5b5466aa24f922a296edc39'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.462051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afea10ed5b5466aa24f922a296edc39'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.493473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0925c914747e49e3b51bdb173ec6bae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.501658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afea10ed5b5466aa24f922a296edc39'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.554258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0925c914747e49e3b51bdb173ec6bae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.591987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afea10ed5b5466aa24f922a296edc39'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.592625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c70ad1f-645f-4900-8ed5-b7f9298f3db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afea10ed5b5466aa24f922a296edc39'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.636929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 822/1641] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:46:55 2022] DELETE /identity/v3/users/6afea10ed5b5466aa24f922a296edc39 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:56.642014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:56.642336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:56.642616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:56.691319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:56.693797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:56.706352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0925c914747e49e3b51bdb173ec6bae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.708654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0925c914747e49e3b51bdb173ec6bae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.709413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ea6e9f7-d32a-49b7-a5b2-edf119692b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0925c914747e49e3b51bdb173ec6bae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:56.742663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 820/1642] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:46:55 2022] DELETE /identity/v3/users/0925c914747e49e3b51bdb173ec6bae1 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:46:56.748493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:56.748493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:56.748493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:56.805732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:46:56.807654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:56.835684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:56.922678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 823/1643] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:46:57.009643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:46:57.017724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 821/1644] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:46:57.240019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:57.242549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:57.247082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:57.248681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:57.424471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6ea6-96d8-4c4f-87a9-42b7cce7739e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:57.426133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2eaa92-c778-41fe-83a9-b1e6568a3a3a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:57.441095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:57.441353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:57.441487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:57.446787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:57.447231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:57.447231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:57.447371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:57.447371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:57.471176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:57.472664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:57.477361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:57.479170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:57.512167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 822/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:57.512427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 824/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:46:59.397177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:59.399340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:59.428471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef4934-e83f-4913-9eec-216b8ff43e98 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:59.443207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:59.444250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:59.444250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:59.444451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] PATH_INFO: `/v3/projects/8fff07d9bde345e2aad41598a71eef12` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:59.449129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fff07d9bde345e2aad41598a71eef12)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:59.453938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:59.502680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:46:59.504769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:46:59.537828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35794d-2e59-41a1-9978-6c0af9e41b32 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:46:59.553181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:46:59.554536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:46:59.556146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:46:59.556687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] PATH_INFO: `/v3/projects/2974de9c06c940fe97436b66d66a8208` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:46:59.563441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2974de9c06c940fe97436b66d66a8208)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:46:59.565152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: WARNING py.warnings [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 12:46:59.565152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: warnings.warn(msg) Aug 22 12:46:59.565152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: Aug 22 12:46:59.566643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:46:59.721283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fff07d9bde345e2aad41598a71eef12', 'request_id': 'req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:59.786895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2974de9c06c940fe97436b66d66a8208', 'request_id': 'req-4646e6ee-85fd-4384-8383-a6422c1ce75c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:59.843395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2974de9c06c940fe97436b66d66a8208', 'request_id': 'req-4646e6ee-85fd-4384-8383-a6422c1ce75c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:59.935509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fff07d9bde345e2aad41598a71eef12', 'request_id': 'req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:46:59.949214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fff07d9bde345e2aad41598a71eef12', 'request_id': 'req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.000060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] The token cache is being invalidate because project 8fff07d9bde345e2aad41598a71eef12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:00.000362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.003344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8156e211-a8d4-4ae6-8bb0-2794ad22fbdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.010955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 823/1647] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:46:59 2022] DELETE /identity/v3/projects/8fff07d9bde345e2aad41598a71eef12 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:00.012462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8139a0-2593-4e70-a9a8-cb723a74bfac None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:00.012644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8139a0-2593-4e70-a9a8-cb723a74bfac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:00.021175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8139a0-2593-4e70-a9a8-cb723a74bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:00.026011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2974de9c06c940fe97436b66d66a8208', 'request_id': 'req-4646e6ee-85fd-4384-8383-a6422c1ce75c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.053643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] The token cache is being invalidate because project 2974de9c06c940fe97436b66d66a8208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:00.053939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.058612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.066891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 825/1648] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:46:59 2022] DELETE /identity/v3/projects/2974de9c06c940fe97436b66d66a8208 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:00.069119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:00.070127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:00.079294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2b8139a0-2593-4e70-a9a8-cb723a74bfac None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:00.084322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2b8139a0-2593-4e70-a9a8-cb723a74bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:00.260126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 824/1649] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:00.267274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:00.268216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:00.268501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:00.273825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646e6ee-85fd-4384-8383-a6422c1ce75c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:00.294120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:00.296157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:00.299942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:00.300315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] PATH_INFO: `/v3/users/cf03802e4d674a3c831cdfceafb94a7f` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:00.303148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf03802e4d674a3c831cdfceafb94a7f)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:00.308445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:00.317498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:00.347002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:00.352932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:00.354448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:00.393257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 825/1650] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:00.397553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:00.419048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74186be-367c-4765-b7ee-25ae3dae1920 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:00.431214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:00.432412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:00.432829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:00.433237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:00.435868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:00.436319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:00.439739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:00.466929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 826/1651] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:00.478326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:00.495252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e33d99-f661-43d4-a0e1-840e89a5b835 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:00.517588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:00.518486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:00.518894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:00.519289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:00.521088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:00.526495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:00.586959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf03802e4d674a3c831cdfceafb94a7f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.588636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf03802e4d674a3c831cdfceafb94a7f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.616409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf03802e4d674a3c831cdfceafb94a7f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.680902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 827/1652] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:00.681971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:00.687125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:00.689095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf03802e4d674a3c831cdfceafb94a7f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.689747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf03802e4d674a3c831cdfceafb94a7f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:00.707250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 826/1653] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:00 2022] DELETE /identity/v3/users/cf03802e4d674a3c831cdfceafb94a7f => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:00.881056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa8e55-3b14-480b-9f15-66f77fd51880 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:01.112471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:01.113128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:01.113413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:01.113737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:01.114484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:01.120247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:01.320345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 828/1654] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:00 2022] POST /identity/v3/users => generated 289 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:01.324586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:01.341628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d006-7c6c-42ff-a122-bff5e1396d89 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:01.364562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:01.365537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:01.366022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:01.366568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:01.367428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:01.375668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:01.410162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 827/1655] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:01.419464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:01.432285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dcc76-62fc-4858-a099-235e767a8531 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:01.446233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:01.447002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:01.447427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:01.447800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:01.448560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:01.452720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726a97-b083-4c50-be17-811ce6b3d1d8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:01.496012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 829/1656] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:01.500647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:01.518506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963b3d-6056-489a-800a-d24192eafd4f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:01.550001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:01.551022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:01.551346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:01.551563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] PATH_INFO: `/v3/projects/1a5f860a62c4447a8d9b482e3741a9a7/users/954e0aa47f954c4393cd8f4ff2e9ed88/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:01.589927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5f860a62c4447a8d9b482e3741a9a7, user_id=954e0aa47f954c4393cd8f4ff2e9ed88, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:01.601032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:01.685644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 828/1657] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:01 2022] PUT /identity/v3/projects/1a5f860a62c4447a8d9b482e3741a9a7/users/954e0aa47f954c4393cd8f4ff2e9ed88/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:01.696577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:01.696965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:01.697318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:01.781733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] MFA Rules not processed for user `954e0aa47f954c4393cd8f4ff2e9ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:01.781733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:01.889010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:01.980865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 830/1658] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:01.986069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:02.111693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70caae-f17c-400c-bdcf-face1d64d7f9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:02.118961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:02.119714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:02.119996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:02.120271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:02.120908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:02.127380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:02.396487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 829/1659] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:01 2022] POST /identity/v3/projects => generated 377 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:02.400798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:02.417732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef4690-4c1b-4979-a51b-96ca113d4664 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:02.615798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:02.615798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:02.615798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:02.615798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:02.617550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:02.617550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:02.715339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:02.718412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:02.769101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689a326-27b1-42e1-bfaf-0d57b199525a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:02.803944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:02.804817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:02.805258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:02.809769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] PATH_INFO: `/v3/projects/2a6266cbb736488299ab5a3b8b0d6271` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:02.809769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6266cbb736488299ab5a3b8b0d6271)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:02.815348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:02.819548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 831/1660] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:02 2022] POST /identity/v3/users => generated 295 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:02.821335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:02.879064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f4e93-23d2-4505-ab52-206c3809cfdb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:02.888567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:02.891563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:02.892032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:02.894111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:02.896214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:02.899309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197975-c233-4fe5-8097-daa7386fcc2a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:02.943586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 832/1661] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:02.945065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:02.955178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:02.955506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:02.973956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:02.999935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6266cbb736488299ab5a3b8b0d6271', 'request_id': 'req-c4877c04-9d96-43a9-908d-548541bb57f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.025464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6266cbb736488299ab5a3b8b0d6271', 'request_id': 'req-c4877c04-9d96-43a9-908d-548541bb57f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.072250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] MFA Rules not processed for user `9767d18cf0944f16b45fff4214128c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:03.073513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:03.106898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6266cbb736488299ab5a3b8b0d6271', 'request_id': 'req-c4877c04-9d96-43a9-908d-548541bb57f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.136252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] The token cache is being invalidate because project 2a6266cbb736488299ab5a3b8b0d6271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:03.137501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.139674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.148606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 830/1662] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:02 2022] DELETE /identity/v3/projects/2a6266cbb736488299ab5a3b8b0d6271 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:03.149592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:03.156167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:03.255169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 833/1663] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:03.256242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:03.275525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:03.409544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:03.414744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4877c04-9d96-43a9-908d-548541bb57f7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:03.427913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:03.428836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.429255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.429696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] PATH_INFO: `/v3/users/a188768395324f928027ea6f72e7f9de` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:03.433210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a188768395324f928027ea6f72e7f9de)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:03.436316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:03.450087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b76837-8830-4063-86a5-9fe2fb6747c7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:03.465151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:03.466162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.466648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.467185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] PATH_INFO: `/v3/projects/5e2f708685ef41d1b7ced734adb1f87d/users/9c48f56990994c9793dbb7bd53c304b2/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:03.508554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2f708685ef41d1b7ced734adb1f87d, user_id=9c48f56990994c9793dbb7bd53c304b2, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:03.511661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e306a-5ae6-4250-ae1a-95c24899d791 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:03.657625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 834/1664] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:03 2022] PUT /identity/v3/projects/5e2f708685ef41d1b7ced734adb1f87d/users/9c48f56990994c9793dbb7bd53c304b2/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:03.659977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e1ee-6b1a-407b-b9e4-4138a13427ba None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.660393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e1ee-6b1a-407b-b9e4-4138a13427ba None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.660848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e1ee-6b1a-407b-b9e4-4138a13427ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:03.719587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5690e1ee-6b1a-407b-b9e4-4138a13427ba None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:03.721418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5690e1ee-6b1a-407b-b9e4-4138a13427ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:03.764948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a188768395324f928027ea6f72e7f9de'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.772099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a188768395324f928027ea6f72e7f9de'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.810877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 835/1665] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:03.811616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a188768395324f928027ea6f72e7f9de'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.812259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.813096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.813379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:03.882386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] MFA Rules not processed for user `9767d18cf0944f16b45fff4214128c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:03.884378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:03.911420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a188768395324f928027ea6f72e7f9de'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.912290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5e75e50e-223e-4c37-a5b9-dc6dd6eb4a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a188768395324f928027ea6f72e7f9de'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:03.936100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 831/1666] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:03 2022] DELETE /identity/v3/users/a188768395324f928027ea6f72e7f9de => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:03.940820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad8cc-99bf-4a2a-a167-ce8a11415e72 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:03.945080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad8cc-99bf-4a2a-a167-ce8a11415e72 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:03.945507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad8cc-99bf-4a2a-a167-ce8a11415e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.053465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 836/1667] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.054950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.060136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.066018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b4bad8cc-99bf-4a2a-a167-ce8a11415e72 None None] MFA Rules not processed for user `56a8835b7a764c65820758eaf7accbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.067291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b4bad8cc-99bf-4a2a-a167-ce8a11415e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.132914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3ae1-1257-4654-adf5-74d8bbd9e214 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.283221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.283602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.283895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.284171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.293646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.293980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 832/1668] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.295565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.296020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.296433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.309378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00b8bb-ec06-4227-926b-225f873a2bd4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.340440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 837/1669] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:04.345411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168422-3583-4647-93dd-559986ccdd5d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.346079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.347561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.348941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168422-3583-4647-93dd-559986ccdd5d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.349267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168422-3583-4647-93dd-559986ccdd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.375994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 833/1670] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.378810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.383054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.405237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-72168422-3583-4647-93dd-559986ccdd5d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.405237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-72168422-3583-4647-93dd-559986ccdd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.436318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 838/1671] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.447340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.447849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.450713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.475010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:04.497415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:04.512051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] MFA Rules not processed for user `56a8835b7a764c65820758eaf7accbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:04.513293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.535458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 839/1672] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:04.536793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.552796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b990656-f95e-4bf6-9af4-bbe3b5c5ee74 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.554316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7aadc-59d1-4767-b16e-c7e3d571e58c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.562121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.563148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.563558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.563939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.564862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.565836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.566014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.566365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] PATH_INFO: `/v3/projects/5e2f708685ef41d1b7ced734adb1f87d/users/9c48f56990994c9793dbb7bd53c304b2/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.567067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.571694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2f708685ef41d1b7ced734adb1f87d, user_id=9c48f56990994c9793dbb7bd53c304b2, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.571694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.588387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 840/1673] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:04 2022] PUT /identity/v3/projects/5e2f708685ef41d1b7ced734adb1f87d/users/9c48f56990994c9793dbb7bd53c304b2/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:04.589720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.688587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.691775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.694348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80a63-5ea2-4770-9f6f-089a15a9c990 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.702579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:04.703445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:04.703832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:04.704216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:04.705011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:04.705421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:04.708271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:04.725546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 834/1674] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:04.727706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.731002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.735484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 841/1675] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:04.736520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:04.739141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:04.991770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca43a3-0136-4556-9402-b5668884089a service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:04.994164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4ad-1ab2-4619-b473-988d4ab00506 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.014733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.017661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.018027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.018403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.111745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.115463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.116784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.138211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.169780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.172500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.175365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.177068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264428-de69-4790-91f9-79cf40cee8a8 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.193830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 842/1676] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:05.196276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 835/1677] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:05.199220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.199525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.200439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.206009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.220587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784e402-4978-400e-9cf6-13199142725d service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.241011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.242402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.242941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.243459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.244169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.250979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.264394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:05.281839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] MFA Rules not processed for user `9c48f56990994c9793dbb7bd53c304b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:05.286674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:05.306624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:05.370630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 836/1678] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:05.376617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.505973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 843/1679] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:05.521368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.523075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:05.600381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f681-0bf6-4146-af07-114915dcf205 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.623154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.623905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.624255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.624589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.627271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.632762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.688785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3c23-ed8c-47cc-8d5e-6f5ba9c65e1a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.743454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 837/1680] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:05 2022] POST /identity/v3/users => generated 295 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:05.748270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.791082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85718eb-d6db-42af-9db9-9942af87d32b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.811857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.813788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.814281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.814747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.815546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.818883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.831944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.834204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.834599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.835841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.845012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:05.855422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 838/1681] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:05.857697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:05.898090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca99bf9-a890-470a-acb2-cedf3656475c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:05.912112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:05.913008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:05.913436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:05.914354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:05.915165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:05.917297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:05.965022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 839/1682] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:05.967159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.018274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d592d84-cfa7-43d8-92ba-778fbb993437 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.040667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.041175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.042287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.042715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.043360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] PATH_INFO: `/v3/projects/d639672af8ba4005b9c5307554cd0e0b/users/292bf3c0ad4b4120a4bce9ff956116c3/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.043678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10053dfa-f6e1-4d47-bb37-4deabf04e11b service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.074313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 844/1683] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:06.085279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d639672af8ba4005b9c5307554cd0e0b, user_id=292bf3c0ad4b4120a4bce9ff956116c3, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.088513 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577c23-9049-4994-834c-96672d1a8107 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.178403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 840/1684] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:05 2022] PUT /identity/v3/projects/d639672af8ba4005b9c5307554cd0e0b/users/292bf3c0ad4b4120a4bce9ff956116c3/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:06.180352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.180947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.181289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.238216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.279982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] MFA Rules not processed for user `292bf3c0ad4b4120a4bce9ff956116c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:06.288272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:06.449342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572cf5-cef2-42b2-a2cf-487cfb2a9526 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.449992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572cf5-cef2-42b2-a2cf-487cfb2a9526 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.450541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572cf5-cef2-42b2-a2cf-487cfb2a9526 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.455385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 841/1685] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 12:47:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:06.466880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b658a-31c3-41ce-9f8b-69df3d2255e8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.468168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b658a-31c3-41ce-9f8b-69df3d2255e8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.469684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b658a-31c3-41ce-9f8b-69df3d2255e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.572296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 845/1686] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:06.580050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.586132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c45b658a-31c3-41ce-9f8b-69df3d2255e8 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:06.587431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c45b658a-31c3-41ce-9f8b-69df3d2255e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:06.684976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:06.773731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 842/1687] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:06.781246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b62ab-8438-49fa-a46a-cecf5a391b6d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.788670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15820b8-8bbf-49af-9915-11880fb1fa08 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.789068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15820b8-8bbf-49af-9915-11880fb1fa08 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.789454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15820b8-8bbf-49af-9915-11880fb1fa08 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.791337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 843/1688] 10.222.0.15 () {54 vars in 912 bytes} [Mon Aug 22 12:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:06.804491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.806609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.806956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.807147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.810336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.810456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.810456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.810456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.812590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.855381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:06.856784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:06.887013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 844/1689] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:06.888332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.918898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f21906-ee2d-45e9-88bb-adbc4f433650 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:06.934029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:06.935259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:06.935769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:06.936244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:06.953569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:06.954900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:06.991559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 845/1690] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:06.993010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:06.998348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 846/1691] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/projects => generated 387 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:07.004746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.009823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1b7f6-5363-4cf2-bd93-799d4766d93b service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.233110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.233751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.234338 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.234803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.236032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2f86-08a8-42dd-bfbb-05748d55645d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.245792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.246268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.248729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.249054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.250240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.253893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.255400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.259642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.302523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 846/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:07.303380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.320893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.392702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 847/1693] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:06 2022] POST /identity/v3/users => generated 300 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:07.396678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.409720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441080d2-ebe9-4c96-9ebf-f23eb7c40149 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.425755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5bb7-85d9-4ace-868c-485a2cbe3678 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.436999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.438669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.439154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.439627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.440902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.460824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.466971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.467833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.470115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.476804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 848/1694] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:07.476982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] PATH_INFO: `/v3/users/4938373d551a46bcbced348d85f9d968` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.478021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.478698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4938373d551a46bcbced348d85f9d968)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.486328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.491079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:07.505255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79957678-a348-45a4-8ca3-1c5a03bdc4e3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.522976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.524138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.524428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.524705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] PATH_INFO: `/v3/projects/5128272b14fd40cab52ce88154b95035/users/6426bcc11cbb41128e8398938e69459b/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.564915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5128272b14fd40cab52ce88154b95035, user_id=6426bcc11cbb41128e8398938e69459b, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.571751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.651052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 849/1695] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:07 2022] PUT /identity/v3/projects/5128272b14fd40cab52ce88154b95035/users/6426bcc11cbb41128e8398938e69459b/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:07.661511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.668825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:07.795259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4938373d551a46bcbced348d85f9d968'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:07.795259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4938373d551a46bcbced348d85f9d968'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:07.813321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4ddc-ef86-41c3-9ecb-023d6396420b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:07.827738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:07.828431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:07.828712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:07.828983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] PATH_INFO: `/v3/projects/d285f70190b04d64a240f7fcf648b7dd` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:07.830141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d285f70190b04d64a240f7fcf648b7dd)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:07.832137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:07.841073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4938373d551a46bcbced348d85f9d968'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:07.934491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4938373d551a46bcbced348d85f9d968'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:07.935998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4938373d551a46bcbced348d85f9d968'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:07.962589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 847/1696] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:07 2022] DELETE /identity/v3/users/4938373d551a46bcbced348d85f9d968 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:07.963851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:07.965804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.032973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd285f70190b04d64a240f7fcf648b7dd', 'request_id': 'req-1a740167-4dc4-43bc-a229-b6ebe2da16e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:08.048659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.100073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd285f70190b04d64a240f7fcf648b7dd', 'request_id': 'req-1a740167-4dc4-43bc-a229-b6ebe2da16e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:08.111614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd285f70190b04d64a240f7fcf648b7dd', 'request_id': 'req-1a740167-4dc4-43bc-a229-b6ebe2da16e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:08.162055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf2ddf-33f9-4ed5-b3e9-632c7c9dfa84 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.162256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] The token cache is being invalidate because project d285f70190b04d64a240f7fcf648b7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:08.162256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:08.162256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1a740167-4dc4-43bc-a229-b6ebe2da16e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:08.165624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 850/1697] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:07 2022] DELETE /identity/v3/projects/d285f70190b04d64a240f7fcf648b7dd => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:08.168140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853246-6d7b-4d4f-bb95-fff2b9eda252 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.169205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853246-6d7b-4d4f-bb95-fff2b9eda252 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.170809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853246-6d7b-4d4f-bb95-fff2b9eda252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.236616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c3853246-6d7b-4d4f-bb95-fff2b9eda252 None None] MFA Rules not processed for user `36a40c9d61174c38b007ba0a30fc95c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.237949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c3853246-6d7b-4d4f-bb95-fff2b9eda252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.308734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.309932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.310426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.311933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.315344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.317358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0eb842-7871-4653-9d72-4e6c9408be3a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.358681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 848/1698] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:08.368717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.368717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.368717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.405408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.417160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 851/1699] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.419353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1e8a-d807-4076-8227-f8ad6d1423de None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.425794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1e8a-d807-4076-8227-f8ad6d1423de None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.426297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1e8a-d807-4076-8227-f8ad6d1423de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.435246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] MFA Rules not processed for user `5b1db5be49014d2cba63cdee9df5b1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.441012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.503848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-490c1e8a-d807-4076-8227-f8ad6d1423de None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.513859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-490c1e8a-d807-4076-8227-f8ad6d1423de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.550375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 852/1700] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.551763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b665-b523-45f2-8303-ecbb237908c6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.552056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b665-b523-45f2-8303-ecbb237908c6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.552337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b665-b523-45f2-8303-ecbb237908c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.616580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 849/1701] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.617554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.620099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.640259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4bd2b665-b523-45f2-8303-ecbb237908c6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.647356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4bd2b665-b523-45f2-8303-ecbb237908c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.665396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 853/1702] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:08.670666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac957d-59ee-4260-a747-92766de015f8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.674169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.674490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.674766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.676463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 854/1703] 10.222.0.15 () {54 vars in 961 bytes} [Mon Aug 22 12:47:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:08.677269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.679496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.692853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.693433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.693712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.693987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] PATH_INFO: `/v3/projects/5128272b14fd40cab52ce88154b95035/users/6426bcc11cbb41128e8398938e69459b/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.695980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5128272b14fd40cab52ce88154b95035, user_id=6426bcc11cbb41128e8398938e69459b, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.699034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.725170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 850/1704] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:08 2022] PUT /identity/v3/projects/5128272b14fd40cab52ce88154b95035/users/6426bcc11cbb41128e8398938e69459b/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:08.726996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:08.738506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:08.794523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037faf29-f2a4-434f-9022-3e4937ba08b4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.815920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:08.842698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232f4a-7342-4123-b151-5c30dac64a9e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:08.849190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.849982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.850402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.850783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.885678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:08.886885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.887177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.888837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.927700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:08.929832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0e011-4c8b-49c5-a111-4f079fb70c73 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:08.944215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 851/1705] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:08.945760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8bd3-6c94-4cbd-81d0-558521411c86 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:08.946285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8bd3-6c94-4cbd-81d0-558521411c86 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:08.946721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8bd3-6c94-4cbd-81d0-558521411c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:08.972205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3a5e8bd3-6c94-4cbd-81d0-558521411c86 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:08.973840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3a5e8bd3-6c94-4cbd-81d0-558521411c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.026117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.026117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2d58b-e78c-42dd-8766-3f16c39d3169 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.050659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 855/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.054141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.058022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.058448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.069373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 852/1707] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:09.069373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.069373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.069373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.100412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] MFA Rules not processed for user `6426bcc11cbb41128e8398938e69459b`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:09.101680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.123055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:09.128188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.206331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 853/1708] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:09.207422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.214761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.248470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 856/1709] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Aug 22 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:09.269101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.269777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.292828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f965b8b-73c7-4666-9289-890eaf092e14 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.304570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.305637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.305637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.309742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.354629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c7e75-bbe7-4c25-8ecf-f48612fc4bd7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.360942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.361309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.361669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.362028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.363994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.394663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.398349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5867d4-27a7-47cd-9ff0-7d8710448e5a service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.412659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.415100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.436073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 854/1710] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.436176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.436415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.436689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.442532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:09.457701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 857/1711] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.471636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.511327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfce8b-b09b-41d8-872d-f9dbf63b5d4c service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.517037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] MFA Rules not processed for user `9767d18cf0944f16b45fff4214128c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:09.518312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.539187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.541672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.542939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.544636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.548424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:09.550083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.552874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.605538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 858/1712] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:09.609911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.612546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:09.664501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 855/1713] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:09.665477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.694430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad932d-03b8-4cba-b7aa-4fdebc92e8f7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.710946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.711822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.712460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.712929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.734751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.736575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.760808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 856/1714] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.760808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:09.777688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aeecc-731e-4d0a-881f-9c6752fe8592 service placement] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.785525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.786857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.787334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.787998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.788309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f576-de50-4e00-8230-ed889a7c083d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:09.789175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.799037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.801594 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:09.806592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:09.806912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:09.807146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:09.841116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:09.846558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:09.867015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:09.873361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 859/1715] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:09.985121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 857/1716] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:09 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:09.988959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.015005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dd359-0119-4298-94a1-72d983712c26 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:10.161308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:10.162064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.162603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.162693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.163272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:10.165274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:10.210953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.228634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0db54-830d-497e-aaa6-75d0709afacf admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:10.243319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:10.244174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.244597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.245013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] PATH_INFO: `/v3/users/292bf3c0ad4b4120a4bce9ff956116c3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.246867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292bf3c0ad4b4120a4bce9ff956116c3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:10.248926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:10.325459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 860/1717] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:09 2022] POST /identity/v3/users => generated 287 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:10.331900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.357338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:10.378551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41dde-26db-43bc-9687-be03f66aa9fa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:10.398297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:10.398941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.403419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.403797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.404649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:10.406970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:10.424025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 861/1718] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:10.425788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.436705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91911f2-80a7-4e7d-a15d-db5ea43cedc7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:10.444864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:10.446829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.447117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.449667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.449667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:10.451317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:10.486440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 862/1719] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:10.491305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.501627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292bf3c0ad4b4120a4bce9ff956116c3'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:10.504058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292bf3c0ad4b4120a4bce9ff956116c3'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:10.515391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d25a2-c4b0-4bbc-b998-58b2828527a0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:10.535887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292bf3c0ad4b4120a4bce9ff956116c3'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:10.539662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:10.541877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.542002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.543973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] PATH_INFO: `/v3/projects/c049ff885f384f758aea657af1f93482/users/d4826a85c79a42e89f9cd236e27f54be/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.547342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:10.591178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c049ff885f384f758aea657af1f93482, user_id=d4826a85c79a42e89f9cd236e27f54be, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:10.595293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:10.712841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292bf3c0ad4b4120a4bce9ff956116c3'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:10.714505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0ecf27b5-4c39-47f5-83d9-f93474b8b428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292bf3c0ad4b4120a4bce9ff956116c3'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:10.721259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 863/1720] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:10 2022] PUT /identity/v3/projects/c049ff885f384f758aea657af1f93482/users/d4826a85c79a42e89f9cd236e27f54be/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:10.722671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:10.767162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:10.796247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 858/1721] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:10 2022] DELETE /identity/v3/users/292bf3c0ad4b4120a4bce9ff956116c3 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:10.799496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069160-47c7-42d7-9776-2142501552b8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:10.800244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069160-47c7-42d7-9776-2142501552b8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:10.800722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069160-47c7-42d7-9776-2142501552b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:10.947752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e0069160-47c7-42d7-9776-2142501552b8 None None] MFA Rules not processed for user `d4826a85c79a42e89f9cd236e27f54be`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:10.950463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e0069160-47c7-42d7-9776-2142501552b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.036534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df70e4-eb80-47b7-a130-4b19a4137a71 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.277060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 859/1722] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:11.281907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.282383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.282892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.304782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.306096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.306566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.306986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] PATH_INFO: `/v3/projects/3109ccf16c2146d1b8a1413cf7e0a851` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.310494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3109ccf16c2146d1b8a1413cf7e0a851)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:11.316026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:11.339926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:11.342283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.380385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 860/1723] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:11.381669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:11.395782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.423668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccf37a-1ed4-42fd-ac39-b736b713bd1e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.432147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.433119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.433641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.434118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.435033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:11.438148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:11.537260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3109ccf16c2146d1b8a1413cf7e0a851', 'request_id': 'req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.573504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 861/1724] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:11.575106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:11.577042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.613979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3109ccf16c2146d1b8a1413cf7e0a851', 'request_id': 'req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.625572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3109ccf16c2146d1b8a1413cf7e0a851', 'request_id': 'req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.641129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:11.664405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] The token cache is being invalidate because project 3109ccf16c2146d1b8a1413cf7e0a851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:11.666665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.670774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:11.677595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 864/1725] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:10 2022] DELETE /identity/v3/projects/3109ccf16c2146d1b8a1413cf7e0a851 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:11.681459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:11.686744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.738615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80706916-8745-469b-959c-b5ccabc6f45f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.747747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.748396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.748814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.748978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.753730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.881684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:11.884321 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade949-b65c-4cd3-af65-5f2a40a3e5b4 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:11.889957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:11.900883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 862/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:11.902454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f4d6-8a56-4fcf-aa59-f1334ee44765 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.902885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f4d6-8a56-4fcf-aa59-f1334ee44765 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.903402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1f4d6-8a56-4fcf-aa59-f1334ee44765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.931966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-66d1f4d6-8a56-4fcf-aa59-f1334ee44765 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:11.933312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-66d1f4d6-8a56-4fcf-aa59-f1334ee44765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:11.958058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76aaf-c9ce-408b-8a5b-d81d9ba94135 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:11.959350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 863/1727] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:11.963454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.963803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.964089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.964309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:11.965016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:11.965300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:11.965625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:11.966356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:11.982690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.001747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:12.003214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:12.016159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 864/1728] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:12.017118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.027424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3523fc-1649-4e05-a6a2-d050af7f87e7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.033953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.033953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.033953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.034353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.034708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:12.035016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.036630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.055543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 865/1729] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:12.062765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.111631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 865/1730] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:11 2022] POST /identity/v3/users => generated 293 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:12.112613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.112908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181b97-a09b-4898-8b40-9a0847b18b78 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.132082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.132806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.133092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.134007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.134704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.138559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.145941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ba0cf-b100-4c50-907b-08887cfe3310 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.161340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.161340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.161340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.161340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.161652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.161652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.169650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 866/1731] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:12.175064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.186345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09e33-99f3-45c2-8fa3-5e5bb6c8615f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.191475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.192219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.193025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.193135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] PATH_INFO: `/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e/users/f0acdb0f5c954dd79d686f64f97b9724/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.213021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8787cef29e74beeac6f05f0b4c1e29e, user_id=f0acdb0f5c954dd79d686f64f97b9724, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.216579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.337670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 866/1732] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:12 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:12.339016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.340963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:12.377554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 867/1733] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:12 2022] PUT /identity/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e/users/f0acdb0f5c954dd79d686f64f97b9724/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:12.378737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.422948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0dd29-2722-4303-aea9-b527215a62f3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.469993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f580f2-4872-4561-9957-19906f81a809 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.480369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.480932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.481213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.481479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.482105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.486637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.513416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.514322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.514726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.515082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.517013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:12.602328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.604011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.618816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 867/1734] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:12.619624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.621996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 868/1735] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:12 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:12.627760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.650509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5892-9295-49d1-986d-0a79f65a176d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.658330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.659232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.659576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.659961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.660677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.661191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0e89-e471-445b-bdf0-283f6ce1783e service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.662635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.683017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 869/1736] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:12.686548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.687903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.688539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.688821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.689098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.689748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.706008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533b1-cff6-4085-8c8a-1b9e931f672f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.715518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.716174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.717041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.717577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.718343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.719617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.724927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.745834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 870/1737] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:12.751047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.756152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 868/1738] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:12.757914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:12.767829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f4f60-dbdc-4356-aca6-cc5ca2a0d6e5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.781967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.781967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.781967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.781967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] PATH_INFO: `/v3/projects/f98ad5d6b9e94cf9a6440671ebc88ac3/users/8b03d76ccf6a41c9bc032d1c3cf707b0/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.782559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:12.803821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136db71-ac53-4c4b-ae74-e7cc717f95d3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:12.820928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98ad5d6b9e94cf9a6440671ebc88ac3, user_id=8b03d76ccf6a41c9bc032d1c3cf707b0, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.821944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:12.822897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.823380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.823868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] PATH_INFO: `/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e/users/f0acdb0f5c954dd79d686f64f97b9724/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.828789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8787cef29e74beeac6f05f0b4c1e29e, user_id=f0acdb0f5c954dd79d686f64f97b9724, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:12.836634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97f0e-fede-42bc-8e26-236dd33e1fb7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.837795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd34043-aee4-4d86-89cb-55bb4cf122cf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:12.850584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:12.880366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 869/1739] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:12 2022] PUT /identity/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e/users/f0acdb0f5c954dd79d686f64f97b9724/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:12.890768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.891360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.891837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:12.973113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 871/1740] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:12 2022] PUT /identity/v3/projects/f98ad5d6b9e94cf9a6440671ebc88ac3/users/8b03d76ccf6a41c9bc032d1c3cf707b0/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:12.973785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] MFA Rules not processed for user `f0acdb0f5c954dd79d686f64f97b9724`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:12.975265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:12.990367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:12.991921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:12.992395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:13.084208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] MFA Rules not processed for user `8b03d76ccf6a41c9bc032d1c3cf707b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:13.085900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:13.162664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 870/1741] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:13.165683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:13.167367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:13.319107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a956ef-9482-4926-bf3e-3f76b8a97320 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:13.326105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:13.328879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:13.328879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:13.328879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:13.352203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:13.352696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 872/1742] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:13.357770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:13.357966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:13.373779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 871/1743] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:13.497186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9cdb-8f47-47e7-ab06-daa15cd88acf None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:13.506393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:13.507063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:13.507707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:13.507983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:13.509204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:13.513582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:13.617322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:13.621782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:13.668438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 873/1744] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:13 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:13.669702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:13.675021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b944a6c-1b5d-4181-bd81-350692bef0dc service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:13.788431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d21d56-8fe2-4947-a5c2-55652817560b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:13.795907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:13.797333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:13.798473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:13.798473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:13.802703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:13.802703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:13.808462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:13.809634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:13.810121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:13.810389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] PATH_INFO: `/v3/projects/d639672af8ba4005b9c5307554cd0e0b` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:13.811577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d639672af8ba4005b9c5307554cd0e0b)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:13.813856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:13.892758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:13.955571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 874/1745] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:13 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:13.955571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.042900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd639672af8ba4005b9c5307554cd0e0b', 'request_id': 'req-545e087c-a543-4b06-99fa-d3bbebe5852c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.055570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd639672af8ba4005b9c5307554cd0e0b', 'request_id': 'req-545e087c-a543-4b06-99fa-d3bbebe5852c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.090844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:14.099576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0f69-b40e-4519-8320-1e3949921bae admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.161877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd639672af8ba4005b9c5307554cd0e0b', 'request_id': 'req-545e087c-a543-4b06-99fa-d3bbebe5852c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.184036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] The token cache is being invalidate because project d639672af8ba4005b9c5307554cd0e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:14.184663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.186410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.191662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 872/1746] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:13 2022] DELETE /identity/v3/projects/d639672af8ba4005b9c5307554cd0e0b => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:14.192623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.193016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.194043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.194274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.194729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.195437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.197474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.320479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.322107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.347069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 875/1747] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:14.348164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.350907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e087c-a543-4b06-99fa-d3bbebe5852c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.351242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.360714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.362106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.363487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.364524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.365685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.368175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.385510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f669f-6c9e-4bfe-9a41-7573cbb327e5 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.392800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 873/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:14.394833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.400060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.400886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.401164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.401767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] PATH_INFO: `/v3/users/6426bcc11cbb41128e8398938e69459b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.403955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6426bcc11cbb41128e8398938e69459b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.408335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.420992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfe48-acce-41a9-8a23-64a0bf691fb6 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.428861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.431103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.431738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.432582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] PATH_INFO: `/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1/users/eda8627ed1444da8ad36b0d4ef1567f1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.456707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97668ae4b6ca4ce1a17d872c4cc02ac1, user_id=eda8627ed1444da8ad36b0d4ef1567f1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.462061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.575166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 874/1749] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:14 2022] PUT /identity/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1/users/eda8627ed1444da8ad36b0d4ef1567f1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:14.580876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.656934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6426bcc11cbb41128e8398938e69459b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.674499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6426bcc11cbb41128e8398938e69459b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.711658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93863a72-b8bb-47f9-b6ab-0e8e748ba084 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.716584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.717200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.717475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.717742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.718443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.720177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.746216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 875/1750] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:14.749215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:14.753083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6426bcc11cbb41128e8398938e69459b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.753919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6426bcc11cbb41128e8398938e69459b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.754952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ee87226-506c-47c0-b04b-64ae2df4e24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6426bcc11cbb41128e8398938e69459b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:14.771605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034a416-9d3c-4f11-abe0-0d572bc568b5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:14.780571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 876/1751] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:14 2022] DELETE /identity/v3/users/6426bcc11cbb41128e8398938e69459b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:14.798670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:14.799383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.799809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.800090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] PATH_INFO: `/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1/users/eda8627ed1444da8ad36b0d4ef1567f1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.806205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=97668ae4b6ca4ce1a17d872c4cc02ac1, user_id=eda8627ed1444da8ad36b0d4ef1567f1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:14.815499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b683e2-da1b-485c-8f0e-0a6ed69656cf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:14.838977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 876/1752] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:14 2022] PUT /identity/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1/users/eda8627ed1444da8ad36b0d4ef1567f1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:14.850006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d52b3b-8621-45c8-838c-3a0a3dbb4c24 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.850287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d52b3b-8621-45c8-838c-3a0a3dbb4c24 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.850569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d52b3b-8621-45c8-838c-3a0a3dbb4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.882028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:14.882353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:14.883829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:14.902146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:14.954732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] MFA Rules not processed for user `36a40c9d61174c38b007ba0a30fc95c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:14.963509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:14.965883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:14.968997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d0d52b3b-8621-45c8-838c-3a0a3dbb4c24 None None] MFA Rules not processed for user `eda8627ed1444da8ad36b0d4ef1567f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:14.970411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d0d52b3b-8621-45c8-838c-3a0a3dbb4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.114733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 877/1753] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:15.117112 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 877/1754] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:15.129797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.132915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.242288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.242750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.246666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.268815 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39b99e-9260-4464-a165-754ff8d86b2f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.269201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] MFA Rules not processed for user `5b1db5be49014d2cba63cdee9df5b1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:15.271798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.276599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.277241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.277523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.277798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.304512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.305993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.322475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 878/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:15.427310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 878/1756] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:15.617042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.617882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.711714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:15.723348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d168-2ab1-4a98-a607-aff36408ce5a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.732223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.732852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.733136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.733412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.744906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:15.773866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf597a-ed4b-4d2e-a093-fccc305d6495 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:15.785645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:15.786401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:15.786770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:15.787357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] PATH_INFO: `/v3/projects/5128272b14fd40cab52ce88154b95035` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:15.788390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5128272b14fd40cab52ce88154b95035)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.795463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.853402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:15.855174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52308f67-247a-45aa-9a12-a4dd4428f544 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:15.880887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 879/1757] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:15.926551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5128272b14fd40cab52ce88154b95035', 'request_id': 'req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.936781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5128272b14fd40cab52ce88154b95035', 'request_id': 'req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:15.943443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:16.039562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5128272b14fd40cab52ce88154b95035', 'request_id': 'req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:16.052863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] The token cache is being invalidate because project 5128272b14fd40cab52ce88154b95035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:16.053257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:16.053990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ca2e0cd2-d83b-4827-80ee-2c874f9b805c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:16.055810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 879/1758] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:15 2022] DELETE /identity/v3/projects/5128272b14fd40cab52ce88154b95035 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:16.060942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.061296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.061658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.086721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:16.088596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:16.094282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:16.182626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 880/1759] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:16.184365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.184654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.184928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.210165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:16.212094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:16.225768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 880/1760] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:16.227305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.241157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0411b-d102-4b89-abb1-1219c614a738 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.247033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.247812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.248237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.248510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.257378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:16.257378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.257378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.270207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 881/1761] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:47:16.276344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.296154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d196aa-b50f-4256-a25e-12237f0649d5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.302423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.303291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.303719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.304186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.305003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.309124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.636174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 881/1762] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/projects => generated 377 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:16.638135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.657487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e44f-b2c9-45fa-8d6d-bdbf94aa134f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.795948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.797499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.797886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.798302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:16.799047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:16.804758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:16.961375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 882/1763] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:16 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:16.965397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:16.982907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298c25-6bc9-4a36-a49e-3eb698c08434 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:16.995144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:16.997049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:16.998606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:16.999955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.000693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.003547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.034503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 882/1764] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:17.034781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.063620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259194f-25c5-422f-bc01-8886cdf0f9f2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.103375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.104275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.104550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.104996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.105800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.107615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af603422-711e-44b9-a0ec-3890f87f422f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.138853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 883/1765] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:17.149072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.160273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc703-bfaa-4c41-9a62-28c6af7eb4b7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.175950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.176861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.177716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.177716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] PATH_INFO: `/v3/projects/230b3ff8b2e34dc8a1019fadce68abac/users/364e11ae8e1b44ad9f11361679b7def4/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.218474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=230b3ff8b2e34dc8a1019fadce68abac, user_id=364e11ae8e1b44ad9f11361679b7def4, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.224237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.310496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 883/1766] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:17 2022] PUT /identity/v3/projects/230b3ff8b2e34dc8a1019fadce68abac/users/364e11ae8e1b44ad9f11361679b7def4/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:17.321703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.322086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.322593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.404366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] MFA Rules not processed for user `364e11ae8e1b44ad9f11361679b7def4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:17.407845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:17.564040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 884/1767] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:17.564833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:17.693263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53ad66-88f6-47b4-8a4b-df6242d54bde admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:17.708351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:17.709108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:17.709365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:17.709641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:17.710326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:17.712264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b987bb-0312-4ddb-8f87-4baca6ecaae9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:17.993448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 884/1768] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:17 2022] POST /identity/v3/projects => generated 379 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:17.997608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.018645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:18.042196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf0321-2b5a-4652-af70-5bb1ad419488 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.053851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.054133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.058322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.188289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.190719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.192933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.194743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.196916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.206140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.213080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:18.214355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.321140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:18.396503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 885/1769] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:17 2022] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:18.398963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.409059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 885/1770] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:18.438335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db663c-fa11-418d-80ed-18f7a282f14d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.447832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.448612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.448968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.450113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.452213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.454039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.471471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 886/1771] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:18.475563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.494426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89fd8-a507-4dcf-b26e-ca1a9cf1212c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.504850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.505959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.506488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.507137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.507988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.509659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c68809-0503-490e-ac77-a50bc287dcaf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.525575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 886/1772] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:18.530947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.545792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44077e2-55ee-4822-a29d-4c623f436562 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:18.561149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:18.562490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.562817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.563186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] PATH_INFO: `/v3/projects/9ffc5db2833c4f0493e861fe455c284b/users/b651f30b906b4fd6b4edf50ee56eae88/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.599690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffc5db2833c4f0493e861fe455c284b, user_id=b651f30b906b4fd6b4edf50ee56eae88, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:18.603268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:18.730210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 887/1773] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:18 2022] PUT /identity/v3/projects/9ffc5db2833c4f0493e861fe455c284b/users/b651f30b906b4fd6b4edf50ee56eae88/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:18.744604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:18.745344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:18.745886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:18.831217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] MFA Rules not processed for user `b651f30b906b4fd6b4edf50ee56eae88`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:18.833832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.910712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:18.912593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:18.999019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 887/1774] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:19.003596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.087792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9d943-c49f-47a8-ae6a-5e0f6567d8d3 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.101343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.102212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.102562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.103477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.105487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.113362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.187027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354ba3b-abca-43ba-9e95-6965322257d7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.221808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.222384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.222668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.224809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.290073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 888/1775] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:19 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:19.294554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.366845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.370559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afc8ef-98ac-4e0a-bfa5-8dbf6123b03f service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.384875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 888/1776] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:47:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 12:47:19.449091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe198-07d3-4aa3-bba0-7e5c4b2229ce admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.471402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:19.483770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.484416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.484703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.484974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.485859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.490049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.618630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.620344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.620344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.666709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 889/1777] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:19 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:19.667543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.700663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b93f1-0acd-4ed2-9203-88e235b1020e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.708734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:19.713258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:19.721762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.724169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.724472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.724748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.725422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.727122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.765724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 890/1778] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:19.767610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:19.806468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9af2e-f267-432c-b566-9d17cfd8ab1c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:19.832363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:19.833100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:19.833382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:19.833657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] PATH_INFO: `/v3/projects/9ddc95b52e9d43d1abb62f184d468673/users/9e0fe97323474b1fbc559ed03cc3b68a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:19.874765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddc95b52e9d43d1abb62f184d468673, user_id=9e0fe97323474b1fbc559ed03cc3b68a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:19.886730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:19.938345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 889/1779] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Aug 22 12:47:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:20.033992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 891/1780] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:19 2022] PUT /identity/v3/projects/9ddc95b52e9d43d1abb62f184d468673/users/9e0fe97323474b1fbc559ed03cc3b68a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:20.034606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:20.079812 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2186fc-ebb6-4ec0-89ce-09f21c6b0a11 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:20.206920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:20.208322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.209823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.214239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.215189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:20.221276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ae447-1aa9-4f62-89ac-32444f9aacaa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:20.255457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 890/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:20.258717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:20.295442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53edea9-85df-4645-bbc1-b27f3224e93a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:20.301290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:20.302086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.302724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.303079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] PATH_INFO: `/v3/projects/9ddc95b52e9d43d1abb62f184d468673/users/9e0fe97323474b1fbc559ed03cc3b68a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.305237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddc95b52e9d43d1abb62f184d468673, user_id=9e0fe97323474b1fbc559ed03cc3b68a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:20.309501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:20.345192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 892/1782] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:20 2022] PUT /identity/v3/projects/9ddc95b52e9d43d1abb62f184d468673/users/9e0fe97323474b1fbc559ed03cc3b68a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:20.360369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:20.360632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:20.361176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:20.430581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] MFA Rules not processed for user `9e0fe97323474b1fbc559ed03cc3b68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:20.431800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:20.587024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 891/1783] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:20.645045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:20.647256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:20.819518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:20.821036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.227647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4d4b-361b-4ff6-888f-50a73b9a5b90 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.227647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.227647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.227647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.230111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.230111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.230111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.230111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 893/1784] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:21.230889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c914ea9-d132-446c-a300-0a0ebbf5b464 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.230889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.230889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.230889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.234230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.234230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.234230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.234230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 892/1785] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:21.811661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:21.815679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:21.890261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb2f7-43c5-4324-a17c-c40c84dd4f30 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:21.894811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:21.895419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:21.895721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:21.895985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:21.907137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:21.908834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3026bc3-669b-4a75-a93b-d47d469beee5 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:21.919534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 894/1786] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:22.037557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:22.162239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.164651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:22.211132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5f87-b64b-4b51-95b7-a44913dd9d53 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.233111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.238106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.239423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.240265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.432111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.433895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f31eb-af51-4880-a218-9e2940f53e20 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:22.445473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:22.457943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 893/1787] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:22.765924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.772299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.772299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.772299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 895/1788] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:47:22.779925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddef2-e0ad-417a-a3ad-3ea4c71e0f47 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.781463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddef2-e0ad-417a-a3ad-3ea4c71e0f47 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.781463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fddef2-e0ad-417a-a3ad-3ea4c71e0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.827849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f8fddef2-e0ad-417a-a3ad-3ea4c71e0f47 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:22.832477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f8fddef2-e0ad-417a-a3ad-3ea4c71e0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:22.943343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 894/1789] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:22.955771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:22.957560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:22.975032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507dcbc-467a-4530-b27b-667fb5c9c07e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:22.980817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:22.981417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:22.981696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:22.981972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:22.993811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:22.993811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ccc4-6cd6-4871-8ca0-55192e876d7c service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.004794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 896/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:23.056759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.056759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.057165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.058989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 895/1791] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:47:23.085490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.086290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.086899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.106779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:23.107982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:23.117768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 897/1792] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:23.138049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:23.140542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:23.163721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555eef7-e48a-4c39-adbd-4ea4a1a6e2e8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:23.167538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:23.168296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:23.168650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:23.168994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:23.179877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:23.181471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf7238-77c9-4892-8a31-97995505718c service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:23.197557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 896/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:33.459457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=86 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:33.923264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:39.257866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.345005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933842-6602-485b-b3b3-095e59b00bda None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.349751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.350641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.350919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.351260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] PATH_INFO: `/v3/users/364e11ae8e1b44ad9f11361679b7def4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.352488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=364e11ae8e1b44ad9f11361679b7def4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.354778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.587972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364e11ae8e1b44ad9f11361679b7def4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:39.588899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364e11ae8e1b44ad9f11361679b7def4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:39.603246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364e11ae8e1b44ad9f11361679b7def4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:39.715561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364e11ae8e1b44ad9f11361679b7def4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:39.716393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364e11ae8e1b44ad9f11361679b7def4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:39.730428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 898/1794] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:39 2022] DELETE /identity/v3/users/364e11ae8e1b44ad9f11361679b7def4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:39.734993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007222-f271-43ef-bb65-882a9429b325 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.735489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007222-f271-43ef-bb65-882a9429b325 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.735581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007222-f271-43ef-bb65-882a9429b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.776732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-69007222-f271-43ef-bb65-882a9429b325 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:39.794791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-69007222-f271-43ef-bb65-882a9429b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:39.886336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 897/1795] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:39.896877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:39.898907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:39.960132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ba43-6269-4883-ada4-cbf2aa6d735e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.960365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ba43-6269-4883-ada4-cbf2aa6d735e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.960811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ba43-6269-4883-ada4-cbf2aa6d735e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.962213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 898/1796] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:47:39.963328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc06e3-5a0e-424c-a59b-09826e048f1f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:39.967836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:39.968451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.968727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.968995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.973021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:39.976747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:39.976747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:39.979666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:39.981169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:39.991072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 899/1797] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:40.003807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:40.005060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.024439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.025985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.047975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4db2-3a95-4301-bb10-0bd797352704 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.060960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.062205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.063168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.065658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] PATH_INFO: `/v3/users/8b03d76ccf6a41c9bc032d1c3cf707b0` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.067804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b03d76ccf6a41c9bc032d1c3cf707b0)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.072023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.113826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:40.149421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 899/1798] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:40.170837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.172270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.188086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef988-f08a-4e4b-8630-580f937cce60 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.193592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.194222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.194502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.194769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.206139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.207855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676bd9-63ba-4df9-ae3d-a8d6fdec3623 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.219318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 900/1799] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:40.410759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b03d76ccf6a41c9bc032d1c3cf707b0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.411685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b03d76ccf6a41c9bc032d1c3cf707b0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.440084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b03d76ccf6a41c9bc032d1c3cf707b0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.539867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b03d76ccf6a41c9bc032d1c3cf707b0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.540636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b03d76ccf6a41c9bc032d1c3cf707b0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:40.568429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 900/1800] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:40 2022] DELETE /identity/v3/users/8b03d76ccf6a41c9bc032d1c3cf707b0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:40.572743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.573176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.573455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.600588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:40.601871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.630886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.632490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.719512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 901/1801] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:40.747658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1a70d-4282-417f-a7d2-3963fa5ec6a7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.753099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.753944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.754291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.754561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] PATH_INFO: `/v3/projects/230b3ff8b2e34dc8a1019fadce68abac` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.755754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230b3ff8b2e34dc8a1019fadce68abac)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.757741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.759082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:40.761381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:40.795322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:40.847605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a20dd-997b-4a58-83c5-7f118fd3ee96 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:40.853070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:40.854614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:40.855103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:40.855578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:40.868460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:40.871061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:40.895444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 902/1802] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:41.032938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230b3ff8b2e34dc8a1019fadce68abac', 'request_id': 'req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.043454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230b3ff8b2e34dc8a1019fadce68abac', 'request_id': 'req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.161251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230b3ff8b2e34dc8a1019fadce68abac', 'request_id': 'req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.178404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] The token cache is being invalidate because project 230b3ff8b2e34dc8a1019fadce68abac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:41.178694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.179410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.181464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 901/1803] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:40 2022] DELETE /identity/v3/projects/230b3ff8b2e34dc8a1019fadce68abac => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:41.185437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:41.195219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45558b-7715-4c56-8f4b-03ce40cea95f service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:41.258623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:41.259272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.259547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.259869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] PATH_INFO: `/v3/users/b651f30b906b4fd6b4edf50ee56eae88` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.261014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b651f30b906b4fd6b4edf50ee56eae88)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:41.264328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:41.546928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b651f30b906b4fd6b4edf50ee56eae88'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.558974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b651f30b906b4fd6b4edf50ee56eae88'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.653270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b651f30b906b4fd6b4edf50ee56eae88'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.653942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b651f30b906b4fd6b4edf50ee56eae88'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.655064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b651f30b906b4fd6b4edf50ee56eae88'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.668903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:41.672126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 903/1804] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:41 2022] DELETE /identity/v3/users/b651f30b906b4fd6b4edf50ee56eae88 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:41.672497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:41.690296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae283d7f-39e8-4ca1-a1d7-45cbb7ed4db4 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:41.713969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:41.763184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:41.763997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:41.764283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:41.764545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] PATH_INFO: `/v3/projects/f98ad5d6b9e94cf9a6440671ebc88ac3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:41.765719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98ad5d6b9e94cf9a6440671ebc88ac3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:41.767925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:41.900418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98ad5d6b9e94cf9a6440671ebc88ac3', 'request_id': 'req-bc9afe11-3aec-40a7-88c6-1147c408f180'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.908507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98ad5d6b9e94cf9a6440671ebc88ac3', 'request_id': 'req-bc9afe11-3aec-40a7-88c6-1147c408f180'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.985082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98ad5d6b9e94cf9a6440671ebc88ac3', 'request_id': 'req-bc9afe11-3aec-40a7-88c6-1147c408f180'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.998750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] The token cache is being invalidate because project f98ad5d6b9e94cf9a6440671ebc88ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:41.999041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:41.999691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.001190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 902/1805] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:41 2022] DELETE /identity/v3/projects/f98ad5d6b9e94cf9a6440671ebc88ac3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:42.005385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.007014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:42.020932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf767d-4643-4947-99b7-adaac42bcd55 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.085815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:42.117710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.119707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.119707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.119707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] PATH_INFO: `/v3/users/eda8627ed1444da8ad36b0d4ef1567f1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.122506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda8627ed1444da8ad36b0d4ef1567f1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.123879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.185371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.187079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:42.204712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9afe11-3aec-40a7-88c6-1147c408f180 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.210623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.211404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.214531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.214531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] PATH_INFO: `/v3/projects/9ffc5db2833c4f0493e861fe455c284b` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.214531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ffc5db2833c4f0493e861fe455c284b)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.216215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.362206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda8627ed1444da8ad36b0d4ef1567f1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.363765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ffc5db2833c4f0493e861fe455c284b', 'request_id': 'req-8df34657-474c-4706-970a-d15060cf2b1b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.370115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ffc5db2833c4f0493e861fe455c284b', 'request_id': 'req-8df34657-474c-4706-970a-d15060cf2b1b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.376190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda8627ed1444da8ad36b0d4ef1567f1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.461989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ffc5db2833c4f0493e861fe455c284b', 'request_id': 'req-8df34657-474c-4706-970a-d15060cf2b1b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.480753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] The token cache is being invalidate because project 9ffc5db2833c4f0493e861fe455c284b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:42.481225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.482055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.484014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 903/1806] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:42 2022] DELETE /identity/v3/projects/9ffc5db2833c4f0493e861fe455c284b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:42.488016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:42.489609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:42.549856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda8627ed1444da8ad36b0d4ef1567f1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.551124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda8627ed1444da8ad36b0d4ef1567f1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.552275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda8627ed1444da8ad36b0d4ef1567f1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.568062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df34657-474c-4706-970a-d15060cf2b1b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:42.573158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:42.573805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:42.574086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:42.574227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 904/1807] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:42 2022] DELETE /identity/v3/users/eda8627ed1444da8ad36b0d4ef1567f1 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:42.574394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] PATH_INFO: `/v3/users/9e0fe97323474b1fbc559ed03cc3b68a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:42.575539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0fe97323474b1fbc559ed03cc3b68a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:42.578535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:42.769154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0fe97323474b1fbc559ed03cc3b68a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.769857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0fe97323474b1fbc559ed03cc3b68a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.782849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0fe97323474b1fbc559ed03cc3b68a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.858349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0fe97323474b1fbc559ed03cc3b68a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.859029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0fe97323474b1fbc559ed03cc3b68a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:42.875927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 904/1808] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:42 2022] DELETE /identity/v3/users/9e0fe97323474b1fbc559ed03cc3b68a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:43.029749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:43.077554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.079487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.162453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b422c43-243b-485f-939c-065d2adb467c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.225482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.226242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.226605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.226958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] PATH_INFO: `/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.228308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97668ae4b6ca4ce1a17d872c4cc02ac1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.230567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.241336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:43.334565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.336487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.367435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f12482-51b2-4a4d-9d31-fbb1e2f4f237 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.385370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97668ae4b6ca4ce1a17d872c4cc02ac1', 'request_id': 'req-2f60c249-4bf0-4bfe-b620-290298501fb5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.433380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.434280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.434613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.434832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] PATH_INFO: `/v3/projects/9ddc95b52e9d43d1abb62f184d468673` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.436535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddc95b52e9d43d1abb62f184d468673)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.438478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.469718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97668ae4b6ca4ce1a17d872c4cc02ac1', 'request_id': 'req-2f60c249-4bf0-4bfe-b620-290298501fb5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.476969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97668ae4b6ca4ce1a17d872c4cc02ac1', 'request_id': 'req-2f60c249-4bf0-4bfe-b620-290298501fb5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.488487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] The token cache is being invalidate because project 97668ae4b6ca4ce1a17d872c4cc02ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:43.488784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.490123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2f60c249-4bf0-4bfe-b620-290298501fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.491929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 905/1809] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:43 2022] DELETE /identity/v3/projects/97668ae4b6ca4ce1a17d872c4cc02ac1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:43.496554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48065-5ff4-4798-a540-d8edb0e60a1c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.496961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48065-5ff4-4798-a540-d8edb0e60a1c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.497460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a48065-5ff4-4798-a540-d8edb0e60a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.518278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d6a48065-5ff4-4798-a540-d8edb0e60a1c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:43.519502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d6a48065-5ff4-4798-a540-d8edb0e60a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.534642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 906/1810] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:43.536921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.537211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.537542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.556967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddc95b52e9d43d1abb62f184d468673', 'request_id': 'req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.563711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddc95b52e9d43d1abb62f184d468673', 'request_id': 'req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.564005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:43.565347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.624719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 907/1811] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:43.628818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.637541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4a35-5959-4335-89b8-4e7c5c03bc85 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.642175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.642795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.643134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.643347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.643974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:43.644273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.645863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.657541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 908/1812] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:47:43.661877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.672270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7480ed-bf11-4f70-9887-0fe1e71b9818 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.677803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.678431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.678671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.679058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.679566 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.681446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.700456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddc95b52e9d43d1abb62f184d468673', 'request_id': 'req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.712024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] The token cache is being invalidate because project 9ddc95b52e9d43d1abb62f184d468673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:43.712315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.712967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-42de9dfb-1018-43d4-8ba6-cc1c2b2107db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:43.714563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 905/1813] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:43 2022] DELETE /identity/v3/projects/9ddc95b52e9d43d1abb62f184d468673 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:43.721702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af254-44ac-4bbf-8006-2a8fed635270 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.721991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af254-44ac-4bbf-8006-2a8fed635270 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.722292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4af254-44ac-4bbf-8006-2a8fed635270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.742119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-de4af254-44ac-4bbf-8006-2a8fed635270 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:43.743391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-de4af254-44ac-4bbf-8006-2a8fed635270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.754337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 906/1814] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:43.760771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.766859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.766859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.769854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 909/1815] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:43.773778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.775802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.785650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:43.786896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:43.801723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:43.855183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55aba2-bd84-412f-b2df-461f4588254d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.860661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 907/1816] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:43.860787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.861578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.861867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.862156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.862376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.862802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.864776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.884347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b9270-4688-4492-ad79-65f7256f4cd4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.893605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.893605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.893605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.893605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.894028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:43.894028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.894028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.905702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 908/1817] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:43.910031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.919447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceacc48-f50c-4427-86d0-10bb48e8235f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:43.927507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:43.930970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:43.930970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:43.930970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:43.930970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:43.931279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:43.987244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 910/1818] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/users => generated 278 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:43.988417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:43.999167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c534c-3b5b-47dc-a47e-eee3066b62f9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.003982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.004668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.004852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.005445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.006009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.007755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.018832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 909/1819] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:43 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:44.019854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.022820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 911/1820] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:44.027088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.040117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb00bf-69f6-47eb-b35e-1fe08171ffe5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.099467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e93e-5cf8-4622-8a68-a653dfd7cd05 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.104466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.105093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.105374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.105651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.106096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.106334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.106489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.106736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.107011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.108273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.108442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.110469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.119765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 912/1821] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:44.124211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.133831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9ef71-c34a-46c6-ad4e-ac12af223a7d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.138563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.139207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.139491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.139762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] PATH_INFO: `/v3/projects/35f4cba04fff471abf3dc544ea808d88/users/eaf4fb457f9c4a7eb1ec9f8d67680f22/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.154304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f4cba04fff471abf3dc544ea808d88, user_id=eaf4fb457f9c4a7eb1ec9f8d67680f22, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.156878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79dc6d-6ef1-4e46-bce0-f9a3425a44cc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.240972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 910/1822] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:44.242051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.252428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1a450-bb99-47de-9f59-71d80c6d3194 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.258116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.258594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.258872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.259139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.259772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.261346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.275973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:44.276509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 911/1823] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:44.281214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.287531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 913/1824] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:44 2022] PUT /identity/v3/projects/35f4cba04fff471abf3dc544ea808d88/users/eaf4fb457f9c4a7eb1ec9f8d67680f22/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:44.298443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb406a-0958-4821-8a76-72895ad9b1be admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.301791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.302692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.302975 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.332231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] MFA Rules not processed for user `eaf4fb457f9c4a7eb1ec9f8d67680f22`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:44.333452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:44.367292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.367991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.367991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.368178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.368765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.370390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.380393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 912/1825] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:44.384764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.395667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472c7f-c5c9-4821-a294-1def36ff4935 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.400582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.401238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.401730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.402009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] PATH_INFO: `/v3/projects/3b5730cbb0064c3db649ea5888e6adec/users/998356d9be724bccbb3dedf035b33322/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.409972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 914/1826] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:44.414809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.417930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5730cbb0064c3db649ea5888e6adec, user_id=998356d9be724bccbb3dedf035b33322, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.421235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020505-6c14-497d-9106-96f04a88c258 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.427291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b1f8f-fed8-4bc3-a5e9-2086f4cc953b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.432787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.433521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.433908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.434202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.434835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.436907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.550627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 913/1827] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:44 2022] PUT /identity/v3/projects/3b5730cbb0064c3db649ea5888e6adec/users/998356d9be724bccbb3dedf035b33322/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:44.563619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.563903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.564178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.609505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 915/1828] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/projects => generated 357 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:44.610581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] MFA Rules not processed for user `998356d9be724bccbb3dedf035b33322`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:44.612128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:44.614064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.693721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 914/1829] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:44.698575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.714721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984698a0-44e5-49e5-9398-ca97d6f69f85 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.721714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.722504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.730284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.730284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.730284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.730284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.770473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4f1fc-9634-47e7-be51-c9aa6f8d1bf8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.775191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:44.775809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:44.776084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:44.776355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:44.776988 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:44.781685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:44.922139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 916/1830] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:44.923691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:44.945517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 915/1831] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:44.954021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94c076-8137-4a4e-acc7-ea8cb31f654a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:44.954730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.058308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.059066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.059368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.059608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.060464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.063153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.072279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651577-1c75-4e2c-8961-9ad9d6199c40 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.077398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 917/1832] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:45.081775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.083663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.084286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.084557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.084823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.085458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.087645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.115363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:45.115782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996cfd-99c2-4db4-907f-146751567e06 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.125267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.125792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.126070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.126391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] PATH_INFO: `/v3/projects/264e9d9af09246c6ace3f4d2c2074e57/users/c89c922a6034485782c7e1ee564b8c7a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.153190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264e9d9af09246c6ace3f4d2c2074e57, user_id=c89c922a6034485782c7e1ee564b8c7a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.157320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.200398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 916/1833] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:44 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:45.208597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.215088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bc8f-dc17-4d25-b57f-44b4ab65aff5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.225753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.226656 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.227096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.227607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.228930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.231968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.246686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 917/1834] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:45.249871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.262087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d00c1-f642-4699-b52a-e8df23112254 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.272748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.274994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.274994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.275244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 918/1835] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:45 2022] PUT /identity/v3/projects/264e9d9af09246c6ace3f4d2c2074e57/users/c89c922a6034485782c7e1ee564b8c7a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:45.282445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] PATH_INFO: `/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2/users/8dee41be2caf4726a955031de0020e7a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.284932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.321714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b75004b5d545e1b30dc6dbe8aea8a2, user_id=8dee41be2caf4726a955031de0020e7a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.324600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.380603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343309-6dcb-4630-8245-4630acb548d7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.385440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.386155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.386545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.386890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.387749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.390051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.400454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 919/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:45.404773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.414631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2ad98-e801-44e4-b2f1-92fdb3898d03 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.419554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.420323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.420673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.420960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] PATH_INFO: `/v3/projects/264e9d9af09246c6ace3f4d2c2074e57/users/c89c922a6034485782c7e1ee564b8c7a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.423345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264e9d9af09246c6ace3f4d2c2074e57, user_id=c89c922a6034485782c7e1ee564b8c7a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.425978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf5b09-1015-41ec-b996-641874d32256 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.437917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 920/1837] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:45 2022] PUT /identity/v3/projects/264e9d9af09246c6ace3f4d2c2074e57/users/c89c922a6034485782c7e1ee564b8c7a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:45.449268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.449559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.449839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.462460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 918/1838] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:45 2022] PUT /identity/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2/users/8dee41be2caf4726a955031de0020e7a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:45.465995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.494706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] MFA Rules not processed for user `c89c922a6034485782c7e1ee564b8c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:45.495944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:45.566875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1edc0-0da3-45c2-b86f-dbe3a474719d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.573872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.574617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.574896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.576813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.576813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.578137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.589705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 919/1839] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:45.593779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.602855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 921/1840] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:45.610238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56eb7b-9ec1-471d-80ce-b79887b8549f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.610890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.612829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:45.615498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.616158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.616436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.616706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] PATH_INFO: `/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2/users/8dee41be2caf4726a955031de0020e7a/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.618711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b75004b5d545e1b30dc6dbe8aea8a2, user_id=8dee41be2caf4726a955031de0020e7a, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.621419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c82f4-6405-4157-ad9a-609a86034fcb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.632339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 920/1841] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:45 2022] PUT /identity/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2/users/8dee41be2caf4726a955031de0020e7a/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:47:45.642464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.642749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.643033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.675098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] MFA Rules not processed for user `8dee41be2caf4726a955031de0020e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:45.676264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:45.678670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfb8c1-a22b-4339-8ef5-ef7441f12f36 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.726790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.727357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.727631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.727897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.749199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 921/1842] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:45.760254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:45.761704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:45.774069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a90e-f5d4-4ff7-9114-c9451f8514e7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:45.778116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:45.781866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:45.781866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:45.781866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:45.782157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:45.793009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.794600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.804923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 922/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:45.838625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:45.840104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:45.851310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 922/1844] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:47:46.036915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:46.050821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ad78-25af-42c2-921f-711506e34311 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:46.057016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:46.058573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:46.058962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:46.059269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:46.127720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:46.129154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79515470-904c-48a2-be74-2fabb55d05ef service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:46.139729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 923/1845] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:46.410058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:46.452670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:47.081785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:47.189486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:50.318721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:50.320230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:50.391808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e25c13-5f4e-4324-9310-a6ba283ccd52 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:50.396363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:50.396996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:50.397273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:50.397545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] PATH_INFO: `/v3/users/954e0aa47f954c4393cd8f4ff2e9ed88` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:50.398783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954e0aa47f954c4393cd8f4ff2e9ed88)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:50.400772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:50.862356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954e0aa47f954c4393cd8f4ff2e9ed88'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:50.862356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954e0aa47f954c4393cd8f4ff2e9ed88'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:50.864847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954e0aa47f954c4393cd8f4ff2e9ed88'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:51.109944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954e0aa47f954c4393cd8f4ff2e9ed88'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:51.110845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954e0aa47f954c4393cd8f4ff2e9ed88'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:51.113848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:51.125712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 923/1846] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:50 2022] DELETE /identity/v3/users/954e0aa47f954c4393cd8f4ff2e9ed88 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:51.130603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:51.131376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:51.131708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:51.165269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:51.166638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:51.234683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 924/1847] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:51.244337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:51.245890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:51.313792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66904-d375-4177-b9de-34334d3b1142 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:51.321134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:51.322584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:51.325406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:51.325697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:51.340023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:51.342075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:51.354058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 924/1848] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:52.034325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:52.036300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.069389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:52.070399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b578439-8b9c-4511-b568-6cf7197c97b1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:52.071030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.080454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:52.081073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.081351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.081628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] PATH_INFO: `/v3/projects/1a5f860a62c4447a8d9b482e3741a9a7` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.083294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5f860a62c4447a8d9b482e3741a9a7)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:52.085206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:52.138823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e41e9-f4c9-4347-90fb-4863de3878e1 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:52.144242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:52.144846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.145120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.152887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.155715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:52.229668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5f860a62c4447a8d9b482e3741a9a7', 'request_id': 'req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.236234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:52.237698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:52.249146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 925/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:52.298101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5f860a62c4447a8d9b482e3741a9a7', 'request_id': 'req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.306535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5f860a62c4447a8d9b482e3741a9a7', 'request_id': 'req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.332861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] The token cache is being invalidate because project 1a5f860a62c4447a8d9b482e3741a9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:52.333256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.334994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.338295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 925/1850] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:52 2022] DELETE /identity/v3/projects/1a5f860a62c4447a8d9b482e3741a9a7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:52.341096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:52.358434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d318-a305-4822-be92-7a3f5d8ca4e9 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:52.401844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:52.418022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:52.418718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:52.419079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:52.419380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] PATH_INFO: `/v3/users/9c48f56990994c9793dbb7bd53c304b2` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:52.420727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c48f56990994c9793dbb7bd53c304b2)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:52.422697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:52.669663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c48f56990994c9793dbb7bd53c304b2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.670376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c48f56990994c9793dbb7bd53c304b2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.682438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c48f56990994c9793dbb7bd53c304b2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.784158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c48f56990994c9793dbb7bd53c304b2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.785477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-69934c40-b2af-4767-8350-cb8dc62a4951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c48f56990994c9793dbb7bd53c304b2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:52.801767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 926/1851] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:52 2022] DELETE /identity/v3/users/9c48f56990994c9793dbb7bd53c304b2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:53.471910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:53.473636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:53.488679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66deb-0bc0-48e6-9efd-0ffe5918089a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:53.505920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:53.597911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:53.597911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:53.597911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:53.598325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] PATH_INFO: `/v3/projects/5e2f708685ef41d1b7ced734adb1f87d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:53.599434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2f708685ef41d1b7ced734adb1f87d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:53.601387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:53.762425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2f708685ef41d1b7ced734adb1f87d', 'request_id': 'req-1d467748-2811-4ccc-8d3b-f3a117322e2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:53.835434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2f708685ef41d1b7ced734adb1f87d', 'request_id': 'req-1d467748-2811-4ccc-8d3b-f3a117322e2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:53.842489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2f708685ef41d1b7ced734adb1f87d', 'request_id': 'req-1d467748-2811-4ccc-8d3b-f3a117322e2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:53.853859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] The token cache is being invalidate because project 5e2f708685ef41d1b7ced734adb1f87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:53.854294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:53.855015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d467748-2811-4ccc-8d3b-f3a117322e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:53.856641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 926/1852] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:53 2022] DELETE /identity/v3/projects/5e2f708685ef41d1b7ced734adb1f87d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:53.862691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:53.863187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:53.863325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:53.882948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:53.884160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:53.949125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 927/1853] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:53.959131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:53.959417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:53.959717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:53.980537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:53.981793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:53.990369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 927/1854] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:53.994766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.005108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b1756-dc32-4553-b7b4-024eb5be37ba None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.009771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.010577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.010754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.011025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.011683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:54.011987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.014149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.027035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 928/1855] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:54.031899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.042021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d753c5-c0ba-4564-9064-c7cfde0f8c65 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.047101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.047759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.048036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.048306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.049097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.051063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.174706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 928/1856] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:54 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:54.178956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.198413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9755-c389-4cec-9f55-e10ce27ce0f2 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.297933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:54.309605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.311153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.311631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.312388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.313373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.315703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.452248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 929/1857] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:54 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:54.456255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.467822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc2ca-94e0-4a7e-addf-411b34b124ee admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.473240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.474710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.475190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.475653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.476488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.478714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.514288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 929/1858] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:54.515801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.543924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07ebee-427a-411e-b3b0-bdff27da2fc1 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.550729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.551635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.552060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.552655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.553306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.555180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133e8a6-cc04-4656-92f9-9de3828f7681 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.573999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 930/1859] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:54.581517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:54.607520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53f28d-73a0-4d29-92de-5555ba3fb315 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:54.618725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:54.619645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.620126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.621133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] PATH_INFO: `/v3/projects/1675b9d96e494240a1bb225f38bdf98a/users/a13d1525c3d8418fb56b0dd3f705dfc4/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.647510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1675b9d96e494240a1bb225f38bdf98a, user_id=a13d1525c3d8418fb56b0dd3f705dfc4, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:54.652612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:54.882377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 930/1860] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:54 2022] PUT /identity/v3/projects/1675b9d96e494240a1bb225f38bdf98a/users/a13d1525c3d8418fb56b0dd3f705dfc4/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:54.894081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:54.895061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:54.895593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:54.933806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] MFA Rules not processed for user `a13d1525c3d8418fb56b0dd3f705dfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:54.937443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:55.030465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 931/1861] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:55.034971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.079226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:55.098957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b6537-378e-4d75-a15d-f976dbbc3a92 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.106168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.108531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.109008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.109454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.110334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.112313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.236867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 931/1862] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:55 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:55.241623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.252967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9bae2-402d-4580-b172-ff07010623a7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.319593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.320402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.320682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.320943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.321631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.323555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.424499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 932/1863] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:55 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:55.425644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.436272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017eb8-f1cb-4b48-9982-d2e167849758 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.442096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.443332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.443964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.443964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.444588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.446948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.462394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 932/1864] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:47:55.463598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.476923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2491d11-92c6-4e45-9292-cb81a1673136 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.489355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.490035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.490346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.490619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] PATH_INFO: `/v3/projects/0f665a4dffe0437183113f1e02c82f3a/users/32b99fce95e5461fadbdd2598d57e7c9/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.514248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f665a4dffe0437183113f1e02c82f3a, user_id=32b99fce95e5461fadbdd2598d57e7c9, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.517017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.632131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 933/1865] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:55 2022] PUT /identity/v3/projects/0f665a4dffe0437183113f1e02c82f3a/users/32b99fce95e5461fadbdd2598d57e7c9/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:55.636895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.649348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49260cf-45f4-433d-ac73-76bf351bb274 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.762476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.763306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.763714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.764089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.764851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.766620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58952e2-0830-43d3-a0a0-ab29e82097ba admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.790169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:55.801896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 933/1866] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:47:55.805929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b775e-2bb7-43c5-b413-86212a0f7469 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:55.814622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:55.815440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.815702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.816209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] PATH_INFO: `/v3/projects/0f665a4dffe0437183113f1e02c82f3a/users/32b99fce95e5461fadbdd2598d57e7c9/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.820209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f665a4dffe0437183113f1e02c82f3a, user_id=32b99fce95e5461fadbdd2598d57e7c9, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:55.824514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:55.838443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 934/1867] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:47:55 2022] PUT /identity/v3/projects/0f665a4dffe0437183113f1e02c82f3a/users/32b99fce95e5461fadbdd2598d57e7c9/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:55.850017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:55.850596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:55.850913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:55.911547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] MFA Rules not processed for user `32b99fce95e5461fadbdd2598d57e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:55.912939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:55.996570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 934/1868] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:56.008823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.010691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:56.032013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:56.119413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466ccab-5be6-4e6a-9336-92854349f8b5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.124296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.125137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.125905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.126571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.137903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.139876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5125731-b550-48e3-a6b9-151e746721fe service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.151394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 935/1869] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:56.183466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.278986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e5dd1-fe8d-43bc-8586-005fc1f4d4b0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.286640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.286640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.286640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.286640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] PATH_INFO: `/v3/users/a13d1525c3d8418fb56b0dd3f705dfc4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.288728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13d1525c3d8418fb56b0dd3f705dfc4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.291949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.529195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13d1525c3d8418fb56b0dd3f705dfc4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.547761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13d1525c3d8418fb56b0dd3f705dfc4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.635648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13d1525c3d8418fb56b0dd3f705dfc4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.636289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13d1525c3d8418fb56b0dd3f705dfc4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.636903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13d1525c3d8418fb56b0dd3f705dfc4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:56.649489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 935/1870] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:56 2022] DELETE /identity/v3/users/a13d1525c3d8418fb56b0dd3f705dfc4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:56.654788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.655061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.655329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.674440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:56.675640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:56.744852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 936/1871] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:56.755495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:56.757387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:56.821546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba06d5-08e3-4cf5-81e9-221e6f89a639 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:56.825259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:56.826412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:56.826685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:56.826953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:56.835840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:56.837354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:56.847533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 936/1872] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:47:56.850749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:57.459844 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:57.461999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:57.474013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de674627-21ad-44d2-83b7-cd0697a3c6eb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:57.480617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:57.480938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.481381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.481797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] PATH_INFO: `/v3/projects/1675b9d96e494240a1bb225f38bdf98a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.483032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1675b9d96e494240a1bb225f38bdf98a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:57.485093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:57.676355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1675b9d96e494240a1bb225f38bdf98a', 'request_id': 'req-aac0938e-5205-488b-9f9e-ace9c4066b8d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:57.684783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1675b9d96e494240a1bb225f38bdf98a', 'request_id': 'req-aac0938e-5205-488b-9f9e-ace9c4066b8d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:57.846264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1675b9d96e494240a1bb225f38bdf98a', 'request_id': 'req-aac0938e-5205-488b-9f9e-ace9c4066b8d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:57.859158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] The token cache is being invalidate because project 1675b9d96e494240a1bb225f38bdf98a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:57.859450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:57.860124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:57.861871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 937/1873] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:57 2022] DELETE /identity/v3/projects/1675b9d96e494240a1bb225f38bdf98a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:57.865584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:57.875344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeebfc6-5d89-49f2-b6e8-9ea6020cd0a4 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:57.928501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:57.935510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:57.936341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:57.936562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:57.936940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] PATH_INFO: `/v3/users/32b99fce95e5461fadbdd2598d57e7c9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:57.938197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b99fce95e5461fadbdd2598d57e7c9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:57.940204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:58.285838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b99fce95e5461fadbdd2598d57e7c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.299865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b99fce95e5461fadbdd2598d57e7c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.377738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b99fce95e5461fadbdd2598d57e7c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.378391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b99fce95e5461fadbdd2598d57e7c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.379012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8a93a471-707e-4b9e-9788-40939379408b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b99fce95e5461fadbdd2598d57e7c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:58.391736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 937/1874] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:47:57 2022] DELETE /identity/v3/users/32b99fce95e5461fadbdd2598d57e7c9 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:58.946620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:58.948618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:58.974476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0938e-5205-488b-9f9e-ace9c4066b8d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.043578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:59.104036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.104695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.104973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.105251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] PATH_INFO: `/v3/projects/0f665a4dffe0437183113f1e02c82f3a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.107423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f665a4dffe0437183113f1e02c82f3a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.111101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.275945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f665a4dffe0437183113f1e02c82f3a', 'request_id': 'req-2344e487-8b7d-4bc6-b190-3b505d177b9f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.282670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f665a4dffe0437183113f1e02c82f3a', 'request_id': 'req-2344e487-8b7d-4bc6-b190-3b505d177b9f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.406154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f665a4dffe0437183113f1e02c82f3a', 'request_id': 'req-2344e487-8b7d-4bc6-b190-3b505d177b9f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.418208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] The token cache is being invalidate because project 0f665a4dffe0437183113f1e02c82f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:47:59.418508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.419171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2344e487-8b7d-4bc6-b190-3b505d177b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:47:59.420851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 938/1875] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:47:58 2022] DELETE /identity/v3/projects/0f665a4dffe0437183113f1e02c82f3a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:47:59.426261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.426769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.426769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.453703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:59.455077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:59.521190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 938/1876] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:47:59.530538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.531021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.531406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.551658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:47:59.552893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:47:59.561728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 939/1877] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:47:59.566291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:59.577229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729cf4a-8fb9-4fde-913d-17158f84b4bb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.582200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.582809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.583083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.583353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.583993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:47:59.584458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.586059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.598760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 939/1878] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:47:59.603163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:59.613232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422fa98-c7a9-4b41-a4aa-2113137bef82 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.621061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.621061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.621061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.621061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.621643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.621922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.754485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 940/1879] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:47:59 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:47:59.755580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:47:59.766851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034189b-30ae-43d3-8bcd-d2a5f75db768 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:47:59.834208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:47:59.835083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:47:59.835471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:47:59.835882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:47:59.836621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:47:59.838816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:47:59.850431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:47:59.980799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 940/1880] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:47:59 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:47:59.985693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.004952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa6c3-f01e-4838-928a-b29a0b5c4c2d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.010680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.011459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.011799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.012142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.012847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.015060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.028667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 941/1881] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:00.029748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.040575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93d7b-2a68-44a1-ad2c-b5e34e5b1376 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.045840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.046475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.046756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.047029 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.047664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.050245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9c410-3100-4c7e-9874-1c0696044559 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.061672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 941/1882] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:00.065911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.076796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0438b-02b1-402d-a888-3be350dfc620 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.081306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.081950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.082274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.086385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] PATH_INFO: `/v3/projects/ccd7bd4df5b94a02a50289c0f9207bb5/users/51f404fcae7a4cf980b2afbb7fcfd4db/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.097705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd7bd4df5b94a02a50289c0f9207bb5, user_id=51f404fcae7a4cf980b2afbb7fcfd4db, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.100407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.194926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 942/1883] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:00 2022] PUT /identity/v3/projects/ccd7bd4df5b94a02a50289c0f9207bb5/users/51f404fcae7a4cf980b2afbb7fcfd4db/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:00.205744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.206033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.206341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.237729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] MFA Rules not processed for user `51f404fcae7a4cf980b2afbb7fcfd4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:00.238971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:00.316242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 942/1884] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:00.321063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.383895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f965fb6-c62e-40ea-a957-d7f29dad919a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.389532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.390141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.390453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.390727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.391359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.393313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.404019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:00.545650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 943/1885] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:00.549769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.560526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7ef24-cc8d-46dc-bcf2-0beff0742dd9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.636580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.637257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.637542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.637815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.638966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.641148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.764392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 943/1886] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:00 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:00.766104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.776187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c01e3b-b565-4d95-b4b2-6a661c4bcad6 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.781258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.781862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.782114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.782411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.783036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.784607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.794640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 944/1887] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:00.798883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.808774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c71a1f-3390-4e56-90e5-9c4a07ddb6b0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.813492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.814144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.814452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.814723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] PATH_INFO: `/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a/users/b90a7c7c3e7c432db205544da0d0233c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.831808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab4a3cb2681410189a0cdcef1b6991a, user_id=b90a7c7c3e7c432db205544da0d0233c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.834633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:00.920789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 944/1888] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:00 2022] PUT /identity/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a/users/b90a7c7c3e7c432db205544da0d0233c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:00.924902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:00.936159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86515978-cadf-42cb-871b-cb0d0da370ed admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:00.993628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:00.994280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:00.994538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:00.994806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:00.995498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:00.997056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e1d5c-6373-4b28-9740-ef425bcc84a5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.007937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 945/1889] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:01.016319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.027149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50bde-8485-4cfa-87a1-d144dd666fae admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.032969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.033162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.033621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.033885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] PATH_INFO: `/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a/users/b90a7c7c3e7c432db205544da0d0233c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.036116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab4a3cb2681410189a0cdcef1b6991a, user_id=b90a7c7c3e7c432db205544da0d0233c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.038913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.052715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 945/1890] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:01 2022] PUT /identity/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a/users/b90a7c7c3e7c432db205544da0d0233c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:01.062766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.063112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.063391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.091602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] MFA Rules not processed for user `b90a7c7c3e7c432db205544da0d0233c`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:01.092906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.161590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 946/1891] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:01.173074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.174873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.204699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:01.234310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc6b2-44a0-42fe-b49b-4c9b5a7ed527 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.238716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.239716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.240048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.240546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.250795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.252205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e16365-9eb1-423d-89c3-a8837112de35 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.261908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 946/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:01.338520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.400523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d511c-173e-450f-b9ab-5b2c98c95673 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.405665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.406318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.406597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.406871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] PATH_INFO: `/v3/users/51f404fcae7a4cf980b2afbb7fcfd4db` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.407991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f404fcae7a4cf980b2afbb7fcfd4db)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.409889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.411367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:01.567312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f404fcae7a4cf980b2afbb7fcfd4db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.567928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f404fcae7a4cf980b2afbb7fcfd4db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.580561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f404fcae7a4cf980b2afbb7fcfd4db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.651104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f404fcae7a4cf980b2afbb7fcfd4db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.651715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f404fcae7a4cf980b2afbb7fcfd4db'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:01.667396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 947/1893] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:01 2022] DELETE /identity/v3/users/51f404fcae7a4cf980b2afbb7fcfd4db => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:01.672291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.673123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.673302 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.692480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:01.693664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.769801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 947/1894] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:01.779499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:01.780960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:01.839537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ecbbf-2748-4280-9936-18e443e35708 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:01.843039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:01.843639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:01.843908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:01.844176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:01.853165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:01.854865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:01.864590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 948/1895] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:02.418907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.420446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:02.436376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c199-c1ca-47d4-aee0-dec840a535b9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:02.441399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:02.442064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.442366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.442642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] PATH_INFO: `/v3/projects/ccd7bd4df5b94a02a50289c0f9207bb5` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.443802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd7bd4df5b94a02a50289c0f9207bb5)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:02.445763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:02.543810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd7bd4df5b94a02a50289c0f9207bb5', 'request_id': 'req-19c0b574-2430-471d-b9dc-09ee3d8a2415'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.634716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd7bd4df5b94a02a50289c0f9207bb5', 'request_id': 'req-19c0b574-2430-471d-b9dc-09ee3d8a2415'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.641919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd7bd4df5b94a02a50289c0f9207bb5', 'request_id': 'req-19c0b574-2430-471d-b9dc-09ee3d8a2415'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.654710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] The token cache is being invalidate because project ccd7bd4df5b94a02a50289c0f9207bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:02.655050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.655712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:02.657704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 948/1896] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:02 2022] DELETE /identity/v3/projects/ccd7bd4df5b94a02a50289c0f9207bb5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:02.661816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:02.672860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002609-d7c0-41d6-a537-196bb042e623 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:02.735634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:02.738700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:02.738700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:02.738700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] PATH_INFO: `/v3/users/b90a7c7c3e7c432db205544da0d0233c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:02.738700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90a7c7c3e7c432db205544da0d0233c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:02.739878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:02.762660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:03.018263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90a7c7c3e7c432db205544da0d0233c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:03.018935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90a7c7c3e7c432db205544da0d0233c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:03.032062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90a7c7c3e7c432db205544da0d0233c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:03.154648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90a7c7c3e7c432db205544da0d0233c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:03.155377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f0d2eb20-cbc0-4734-83fd-568565168942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90a7c7c3e7c432db205544da0d0233c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:03.168206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 949/1897] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:02 2022] DELETE /identity/v3/users/b90a7c7c3e7c432db205544da0d0233c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:03.877374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:03.878963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:03.901082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0b574-2430-471d-b9dc-09ee3d8a2415 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:03.948876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:03.958980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:03.995754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:03.995754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:03.995754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] PATH_INFO: `/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:03.995754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab4a3cb2681410189a0cdcef1b6991a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:03.995754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.334032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab4a3cb2681410189a0cdcef1b6991a', 'request_id': 'req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:04.383505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab4a3cb2681410189a0cdcef1b6991a', 'request_id': 'req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:04.391118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab4a3cb2681410189a0cdcef1b6991a', 'request_id': 'req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:04.401342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] The token cache is being invalidate because project 7ab4a3cb2681410189a0cdcef1b6991a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:04.401629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:04.402309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-09cc20f0-3ac9-43e6-80ea-4e71aa5177d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:04.404394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 949/1898] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:03 2022] DELETE /identity/v3/projects/7ab4a3cb2681410189a0cdcef1b6991a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:04.409289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.409833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.409833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.430796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:04.431923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.495282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 950/1899] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:04.504093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.504385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.504730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.526201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:04.527420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:04.539869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 950/1900] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:04.542611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.552561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a96278-7945-451c-b338-7fa18f12fd48 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.557499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.558099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.558862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.563606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.563606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:04.563606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.563606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.578861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 951/1901] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:04.580037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.589883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ea2b1-46c8-4b8f-86af-ddd9788281ac None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.599900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.600543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.600815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.601195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.601816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.604052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.698221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 951/1902] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:04.699417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.710286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9c3a-049f-49b0-a69c-9315e873514d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.773700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.773944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.774247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.774597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.775243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.777132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.886217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 952/1903] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:04 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:04.890452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.900811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1e2f-f0a5-4d3f-a601-2e6299b61c68 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.905912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.906533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.906815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.907090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.907753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.909346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.919967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 952/1904] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:04.923792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.934046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9db222-ee3c-4c13-af6a-a665e24a0910 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.938740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.939377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.939657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.939923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.941094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.942723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7ff9-7ed2-4603-bf7e-a47f0b4abe58 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:04.953437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 953/1905] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:04.957547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:04.968380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04885ae3-7544-46c4-b9a8-5d7f8c236889 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:04.973246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:04.973895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:04.974170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:04.974469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] PATH_INFO: `/v3/projects/0ff381d1dc744e87ba49c3993610cfd3/users/954dcb0a3dc84e82aa789170622d7b2d/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:04.989867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff381d1dc744e87ba49c3993610cfd3, user_id=954dcb0a3dc84e82aa789170622d7b2d, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:04.992555 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.102745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 953/1906] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:04 2022] PUT /identity/v3/projects/0ff381d1dc744e87ba49c3993610cfd3/users/954dcb0a3dc84e82aa789170622d7b2d/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:05.113779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.114062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.114427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.128330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:05.141970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] MFA Rules not processed for user `954dcb0a3dc84e82aa789170622d7b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:05.143180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:05.205332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 954/1907] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:05.209977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.273037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0fec3-136f-41bc-9b76-a2cbd9473cb7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.277887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.278567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.278846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.279123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.279743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.281657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.356429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 954/1908] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:05 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:05.360719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.371546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30c907-6aea-4dd1-99dc-2226f39e6014 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.432068 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.435357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.435357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.435357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.435357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.436379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.498066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 955/1909] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:05 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:05.502048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.507699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:05.513820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab8a8-6896-4943-8c11-5ba490536789 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.518579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.521430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.521430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.521430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.521430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.522040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.532838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 955/1910] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:05.537250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.548025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68b4a1-94f0-4813-8058-f8563de963dd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.553190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.553845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.554117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.554417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] PATH_INFO: `/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519/users/35910c6d72aa4c28aea89e9408cc583d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.569386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e23b9c2f454a63a7bdf1a476fa1519, user_id=35910c6d72aa4c28aea89e9408cc583d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.572202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.698296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 956/1911] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:05 2022] PUT /identity/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519/users/35910c6d72aa4c28aea89e9408cc583d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:05.702877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.715763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313ef9-c36d-477d-9dea-480e24ca493b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.777892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.778578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.778860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.779140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.779836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.781440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86fd0d-047e-4233-b724-82e25c30a603 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.791941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 956/1912] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:05.806522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.812931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22820790-7e64-4e02-8d85-8e914e60fc4c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:05.817820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:05.818516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.818794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.819064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] PATH_INFO: `/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519/users/35910c6d72aa4c28aea89e9408cc583d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.821135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e23b9c2f454a63a7bdf1a476fa1519, user_id=35910c6d72aa4c28aea89e9408cc583d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:05.824148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:05.835847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 957/1913] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:05 2022] PUT /identity/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519/users/35910c6d72aa4c28aea89e9408cc583d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:05.846253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:05.846540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:05.846929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:05.886208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] MFA Rules not processed for user `35910c6d72aa4c28aea89e9408cc583d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:05.886208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:05.966476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 957/1914] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:05.983222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:05.986228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:06.042390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:06.046041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afff999-2ec3-4187-95a6-a1a1932dab71 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:06.049698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:06.050332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.050613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.050885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:06.059630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:06.061082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:06.070604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 958/1915] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:06.323652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:06.333144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2bf34-c4af-422e-887d-0655e79b6a0e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:06.336710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:06.337308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.337587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.337863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:06.397248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:06.397248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac11fd4-aa8f-42ca-a5e4-2f6131d7077a service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:06.405769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 958/1916] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:06.457736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:06.459799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:06.534422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae3a-e3db-4428-8d58-9c2a042c6730 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:06.539248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:06.539914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.540140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.540410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] PATH_INFO: `/v3/users/998356d9be724bccbb3dedf035b33322` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:06.541554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] RBAC: Authorizing `identity:delete_user(user_id=998356d9be724bccbb3dedf035b33322)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:06.543542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:06.832283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998356d9be724bccbb3dedf035b33322'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:06.833158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998356d9be724bccbb3dedf035b33322'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:06.846339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998356d9be724bccbb3dedf035b33322'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:06.965845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998356d9be724bccbb3dedf035b33322'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:06.966525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998356d9be724bccbb3dedf035b33322'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:06.980060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 959/1917] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:06 2022] DELETE /identity/v3/users/998356d9be724bccbb3dedf035b33322 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:06.984483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:06.984947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:06.985059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:07.005020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:07.006268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:07.011356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:07.066408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 959/1918] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:07.076740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:07.078167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:07.147821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64b76-b7b5-4bcd-a7d9-3832b100374b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:07.151717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:07.152628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:07.152989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:07.153343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:07.166920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:07.168497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:07.180324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 960/1919] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:07.665885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:07.667623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:07.683398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e17bf8-a782-40a2-9002-a37953c2b663 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:07.688944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:07.689601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:07.690235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:07.690235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] PATH_INFO: `/v3/projects/3b5730cbb0064c3db649ea5888e6adec` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:07.696874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5730cbb0064c3db649ea5888e6adec)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:07.696874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:07.903998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5730cbb0064c3db649ea5888e6adec', 'request_id': 'req-a9c49252-d39b-40ec-a9b5-b019df8705c4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.005777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5730cbb0064c3db649ea5888e6adec', 'request_id': 'req-a9c49252-d39b-40ec-a9b5-b019df8705c4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.012572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5730cbb0064c3db649ea5888e6adec', 'request_id': 'req-a9c49252-d39b-40ec-a9b5-b019df8705c4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.023984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] The token cache is being invalidate because project 3b5730cbb0064c3db649ea5888e6adec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:08.024271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.024996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.026639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 960/1920] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:07 2022] DELETE /identity/v3/projects/3b5730cbb0064c3db649ea5888e6adec => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:08.030557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:08.040295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de649c4-f409-4194-9eaa-45c7f6c7c5ed service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:08.049461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:08.097313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:08.097936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:08.098238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:08.098542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] PATH_INFO: `/v3/users/8dee41be2caf4726a955031de0020e7a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:08.099747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dee41be2caf4726a955031de0020e7a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:08.101739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:08.355048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dee41be2caf4726a955031de0020e7a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.355667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dee41be2caf4726a955031de0020e7a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.371391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dee41be2caf4726a955031de0020e7a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.491666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dee41be2caf4726a955031de0020e7a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.492336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-47642408-2e5e-48f9-bb28-bb122e28ef87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dee41be2caf4726a955031de0020e7a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:08.509385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 961/1921] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:08 2022] DELETE /identity/v3/users/8dee41be2caf4726a955031de0020e7a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:08.905863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:08.908084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:08.933405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c49252-d39b-40ec-a9b5-b019df8705c4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.001717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.002390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.002672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.002943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] PATH_INFO: `/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.004088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b75004b5d545e1b30dc6dbe8aea8a2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.006200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.133200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:09.142098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b75004b5d545e1b30dc6dbe8aea8a2', 'request_id': 'req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.251895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b75004b5d545e1b30dc6dbe8aea8a2', 'request_id': 'req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.262348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b75004b5d545e1b30dc6dbe8aea8a2', 'request_id': 'req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.276252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] The token cache is being invalidate because project 87b75004b5d545e1b30dc6dbe8aea8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:09.276547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.277195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2cc0fe82-c5d5-4f19-9e15-f1c2ef114051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:09.279014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 961/1922] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:08 2022] DELETE /identity/v3/projects/87b75004b5d545e1b30dc6dbe8aea8a2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:09.286161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.292387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.292387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.308140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:09.309882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.371170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 962/1923] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:09.380047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.380333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.380632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.400510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:09.401689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:09.409657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 962/1924] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:09.413840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.426830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b900-4180-41f3-99e6-41c017c78006 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.429736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.430333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.430722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.430873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.431505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:09.431812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.433568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.447368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 963/1925] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:09.452527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.465093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065f7cd-c31e-4bf7-9d80-e79421918039 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.470869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.471548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.471982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.472328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.473629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.475944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.582201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 963/1926] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:09.584113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.594224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2800cc-35d0-4565-b610-a27f8e006083 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.611517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:09.652181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.652701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.652975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.653267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.653870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.655858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.822695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 964/1927] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:09 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:09.826890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.836980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2466e-dd74-4532-aeda-8b824e6c7b02 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.841670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.842299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.842577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.842842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.843494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.845058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.855106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 964/1928] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:09.859566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.869787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f197e91-87c3-4b4a-a893-f8ed6ef9d58a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.875033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.875628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.875903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.876193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.876823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.878445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025bd09-162c-4e6c-8009-94cd667725bb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:09.888843 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 965/1929] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:09.892972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:09.908274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a976c-a2bc-437d-b99d-0064b641dca0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:09.908274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:09.908274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:09.908686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:09.908686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] PATH_INFO: `/v3/projects/b30424db739e4b7696f23ef001c7d4c1/users/c17021f9f26440a4a95200555783a335/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:09.923326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30424db739e4b7696f23ef001c7d4c1, user_id=c17021f9f26440a4a95200555783a335, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:09.925984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.046595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 965/1930] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:09 2022] PUT /identity/v3/projects/b30424db739e4b7696f23ef001c7d4c1/users/c17021f9f26440a4a95200555783a335/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:10.058763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.059047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.059320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.086405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] MFA Rules not processed for user `c17021f9f26440a4a95200555783a335`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:10.087629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.150762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 966/1931] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:10.163567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:10.165481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:10.228044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d21f91-1292-46ae-ac71-e22a86816d77 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:10.232758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:10.233423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:10.233708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:10.233980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:10.242856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:10.244484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acae007-9dc7-4d78-8322-ac377b8553d3 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:10.254212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 966/1932] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:12.454103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:12.459727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:12.536508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922361e2-2a7a-41ce-8d56-e82a2073da09 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:12.541232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:12.541867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.542146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.542447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] PATH_INFO: `/v3/users/eaf4fb457f9c4a7eb1ec9f8d67680f22` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:12.543609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf4fb457f9c4a7eb1ec9f8d67680f22)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:12.546161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:12.789467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:12.802753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf4fb457f9c4a7eb1ec9f8d67680f22'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:12.803411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf4fb457f9c4a7eb1ec9f8d67680f22'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:12.821582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf4fb457f9c4a7eb1ec9f8d67680f22'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:12.949000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf4fb457f9c4a7eb1ec9f8d67680f22'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:12.949535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf4fb457f9c4a7eb1ec9f8d67680f22'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:12.972191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 967/1933] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:12 2022] DELETE /identity/v3/users/eaf4fb457f9c4a7eb1ec9f8d67680f22 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:12.977616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:12.978674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:12.978674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.001252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:13.002689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.082967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 967/1934] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:13.092729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.094246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.152649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e57a1-a791-43aa-9860-10f77570fb76 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.156765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.157721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.158308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.161622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.169698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.171154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.180527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 968/1935] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:13.579969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.581576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.591729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:13.601483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f7465-880b-44cd-8cf1-d9562afbe361 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.613554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:13.613554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:13.613554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:13.613554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] PATH_INFO: `/v3/projects/35f4cba04fff471abf3dc544ea808d88` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:13.614165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f4cba04fff471abf3dc544ea808d88)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:13.614165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:13.731644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f4cba04fff471abf3dc544ea808d88', 'request_id': 'req-39f2343a-7c37-4766-8bde-7543d968a62b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:13.909519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f4cba04fff471abf3dc544ea808d88', 'request_id': 'req-39f2343a-7c37-4766-8bde-7543d968a62b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:13.920019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.920019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:13.921336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f4cba04fff471abf3dc544ea808d88', 'request_id': 'req-39f2343a-7c37-4766-8bde-7543d968a62b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:13.944231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c272b-eb77-49c7-bc3c-316d30f42a6c service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:13.947333 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] The token cache is being invalidate because project 35f4cba04fff471abf3dc544ea808d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:13.947829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:13.948831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:13.952443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 968/1936] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:13 2022] DELETE /identity/v3/projects/35f4cba04fff471abf3dc544ea808d88 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:13.958602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:13.961189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:14.053117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:14.054131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:14.054634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:14.055103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] PATH_INFO: `/v3/users/c17021f9f26440a4a95200555783a335` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.056622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17021f9f26440a4a95200555783a335)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:14.060156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:14.085266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2343a-7c37-4766-8bde-7543d968a62b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:14.091073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:14.092062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:14.092478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:14.092822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] PATH_INFO: `/v3/users/c89c922a6034485782c7e1ee564b8c7a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.094107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89c922a6034485782c7e1ee564b8c7a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:14.096341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:14.349306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17021f9f26440a4a95200555783a335'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.350045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17021f9f26440a4a95200555783a335'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.351590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89c922a6034485782c7e1ee564b8c7a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.356822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:14.366393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89c922a6034485782c7e1ee564b8c7a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.380192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17021f9f26440a4a95200555783a335'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.434286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89c922a6034485782c7e1ee564b8c7a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.435373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89c922a6034485782c7e1ee564b8c7a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.435983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89c922a6034485782c7e1ee564b8c7a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.448952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 969/1937] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:13 2022] DELETE /identity/v3/users/c89c922a6034485782c7e1ee564b8c7a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:14.449757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:14.451137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:14.460833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:14.503484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17021f9f26440a4a95200555783a335'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.504490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2ba61dee-111a-417c-9907-9a26357ffd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17021f9f26440a4a95200555783a335'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.519773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 969/1938] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:13 2022] DELETE /identity/v3/users/c17021f9f26440a4a95200555783a335 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:14.521571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d8a2-8391-4ab4-b81c-ab48ebec8604 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:14.524196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:14.524480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:14.524754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.545846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:14.547159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:14.584766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:14.585433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:14.585713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:14.585988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] PATH_INFO: `/v3/users/954dcb0a3dc84e82aa789170622d7b2d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.587376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954dcb0a3dc84e82aa789170622d7b2d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:14.589327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:14.611428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 970/1939] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:14.623680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:14.625083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:14.685886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17317a76-496e-45e6-b9d8-2f6e0b0b9b98 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:14.689987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:14.690639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:14.690905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:14.691345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:14.701847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:14.703292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:14.715647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 971/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:14.855582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954dcb0a3dc84e82aa789170622d7b2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.870797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954dcb0a3dc84e82aa789170622d7b2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.989255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954dcb0a3dc84e82aa789170622d7b2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.989883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954dcb0a3dc84e82aa789170622d7b2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:14.990511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f209d977-f365-4ad5-abb2-a233e8876490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954dcb0a3dc84e82aa789170622d7b2d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.002125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.004910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 970/1941] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:14 2022] DELETE /identity/v3/users/954dcb0a3dc84e82aa789170622d7b2d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:15.005076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.009063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.010211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.010650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.024847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180136-452d-4ae0-914e-2235a557b982 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.031240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:15.032728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.083121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:15.102617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.103700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.103977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.104245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] PATH_INFO: `/v3/projects/264e9d9af09246c6ace3f4d2c2074e57` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.105485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=264e9d9af09246c6ace3f4d2c2074e57)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.108626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.112426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 971/1942] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:15.119479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.121266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.128124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:15.188624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb330ca-2a16-4be3-8652-9573ebf47210 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.192660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.193293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.193631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.193908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.203196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.204728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.214564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 972/1943] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:15.247135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264e9d9af09246c6ace3f4d2c2074e57', 'request_id': 'req-076132c3-abe3-4bb6-a80d-8a043de769dc'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.253737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264e9d9af09246c6ace3f4d2c2074e57', 'request_id': 'req-076132c3-abe3-4bb6-a80d-8a043de769dc'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.312076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.312076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.330676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d46652-4d87-4de5-9b3a-8ac11addd304 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.365927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264e9d9af09246c6ace3f4d2c2074e57', 'request_id': 'req-076132c3-abe3-4bb6-a80d-8a043de769dc'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.380689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] The token cache is being invalidate because project 264e9d9af09246c6ace3f4d2c2074e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:15.381247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.382432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-076132c3-abe3-4bb6-a80d-8a043de769dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.388872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 972/1944] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:15 2022] DELETE /identity/v3/projects/264e9d9af09246c6ace3f4d2c2074e57 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:15.390481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a911e3-d2b7-4eb3-92f0-7dd05b72ead3 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.390817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a911e3-d2b7-4eb3-92f0-7dd05b72ead3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.391239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a911e3-d2b7-4eb3-92f0-7dd05b72ead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.417615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.419260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.419723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.420168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] PATH_INFO: `/v3/projects/b30424db739e4b7696f23ef001c7d4c1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.422110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30424db739e4b7696f23ef001c7d4c1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.424697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.432448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d0a911e3-d2b7-4eb3-92f0-7dd05b72ead3 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:15.434376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d0a911e3-d2b7-4eb3-92f0-7dd05b72ead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.451110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 973/1945] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:15.457758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.458298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.458573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.487916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:15.489352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.498729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 974/1946] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:15.503800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.514918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92bf9-2d33-4cba-b017-754f42fcf155 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.521002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.521758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.522696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.523037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.523761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:15.524770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.534057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.549756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 975/1947] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:15.554594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.567120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d61b4-dad6-4a3f-9e35-9798eebcbf72 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.572464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.573226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.574446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.574718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.575916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.578661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.590864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30424db739e4b7696f23ef001c7d4c1', 'request_id': 'req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.720037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30424db739e4b7696f23ef001c7d4c1', 'request_id': 'req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.732037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 976/1948] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:15.733080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.733999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30424db739e4b7696f23ef001c7d4c1', 'request_id': 'req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.747231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] The token cache is being invalidate because project b30424db739e4b7696f23ef001c7d4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:15.747536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.748447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-17e116c9-b0c7-4b5f-9f10-f8ede47efad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:15.753690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 973/1949] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:15 2022] DELETE /identity/v3/projects/b30424db739e4b7696f23ef001c7d4c1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:15.755455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1989d7-2394-4d94-a82e-d1f18d57f933 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.755838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1989d7-2394-4d94-a82e-d1f18d57f933 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.756232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1989d7-2394-4d94-a82e-d1f18d57f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.788476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dd1989d7-2394-4d94-a82e-d1f18d57f933 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:15.790076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dd1989d7-2394-4d94-a82e-d1f18d57f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.820743 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be62-c1d7-4e72-b013-dd060e00a3f4 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.825595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.826236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.827507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.827507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.827507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.829501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.866824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 974/1950] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:15.874951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.875381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.875746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.902046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:15.903584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.915509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 975/1951] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:15.917035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.927071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0624e2-ce0c-4370-b37d-380ac0421387 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.931919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.932531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.932806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.933312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.933712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:15.934009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.936398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.945660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 977/1952] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:15.956689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.956689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:15.957491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 976/1953] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:15.958698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:15.969942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f984d4-d268-4f85-9a1e-f3746cd7d90e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.977160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:15.977902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:15.978589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:15.978737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:15.979376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:15.979497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8bc22-f0f1-4f9b-bc7f-6ebfb2053a0b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:15.981845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:15.999001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.001383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.001383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.001383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.001383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.003015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.017382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 978/1954] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:16.017544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.027327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bef269-7a6e-45d3-8ec6-d9806837c9db admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.032761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.033340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.033610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.033878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.034564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.036093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.050741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 979/1955] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:16.051701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.061595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ad263-884d-4e4f-979e-815162d6b6a6 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.066152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.066819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.067091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.067359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] PATH_INFO: `/v3/projects/f70451d5c75d4b9b851793311cd46603/users/a37f9f2b3df64c46a67f3955ea73ca76/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.092533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70451d5c75d4b9b851793311cd46603, user_id=a37f9f2b3df64c46a67f3955ea73ca76, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.092533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.093080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 977/1956] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:16.094655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.097347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.160600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0dc7a-99d9-4021-a96f-aa5a69ee35f3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.165373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.165999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.166303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.166573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] PATH_INFO: `/v3/projects/0ff381d1dc744e87ba49c3993610cfd3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.167680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff381d1dc744e87ba49c3993610cfd3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.170149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.178215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:16.212382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 980/1957] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:16 2022] PUT /identity/v3/projects/f70451d5c75d4b9b851793311cd46603/users/a37f9f2b3df64c46a67f3955ea73ca76/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:16.221929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.301228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86048-06b1-4900-a2c1-7859e77e6f26 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.304232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff381d1dc744e87ba49c3993610cfd3', 'request_id': 'req-40957fd8-8cd3-440d-8bc7-ea9fda231f97'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.377408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff381d1dc744e87ba49c3993610cfd3', 'request_id': 'req-40957fd8-8cd3-440d-8bc7-ea9fda231f97'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.380944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.381570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.381867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.382195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.387731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.387731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.387949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff381d1dc744e87ba49c3993610cfd3', 'request_id': 'req-40957fd8-8cd3-440d-8bc7-ea9fda231f97'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.406896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] The token cache is being invalidate because project 0ff381d1dc744e87ba49c3993610cfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:16.407284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.408047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40957fd8-8cd3-440d-8bc7-ea9fda231f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.409896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 978/1958] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:16 2022] DELETE /identity/v3/projects/0ff381d1dc744e87ba49c3993610cfd3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:16.410983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.411329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.416326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.440393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:16.441066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] MFA Rules not processed for user `a37f9f2b3df64c46a67f3955ea73ca76`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:16.442342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.483551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 981/1959] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:16 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:16.483551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.483551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.494659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89bbf9-6add-40fd-a983-f22aaa405e98 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.499261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.500228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.500228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.500439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] PATH_INFO: `/v3/users/35910c6d72aa4c28aea89e9408cc583d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.501539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35910c6d72aa4c28aea89e9408cc583d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.503484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.521763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 979/1960] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:16.522790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.524267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.538597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f77b2-c294-4d04-9c97-b14b0a8be9a9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.543243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.543841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.544123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.544392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.545025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.546730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.556523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 980/1961] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:16.557267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.558988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.571028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603824-6be3-43ae-abab-24d555550b91 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.576338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.576890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.577168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.577442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.578036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.579896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.734803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35910c6d72aa4c28aea89e9408cc583d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.735703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35910c6d72aa4c28aea89e9408cc583d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.748486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35910c6d72aa4c28aea89e9408cc583d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.793793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 981/1962] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:16 2022] POST /identity/v3/projects => generated 369 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:16.793793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.795108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.805929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35910c6d72aa4c28aea89e9408cc583d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.806644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35910c6d72aa4c28aea89e9408cc583d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:16.826214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 982/1963] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:16 2022] DELETE /identity/v3/users/35910c6d72aa4c28aea89e9408cc583d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:16.827122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.828507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:16.886891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc2ee-4c14-411b-8abf-7c2e7c094ab0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.914067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e7e0d-e852-4036-a803-ff21a1a72e8b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.919298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.920359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.920835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.921109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.921732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.923682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.953589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.954235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.954519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.954790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:16.955431 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:16.957030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:16.967015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 982/1964] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:16.974958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:16.986696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766ae38-170c-4dff-a3c3-3df82acf94e6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:16.991864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:16.992738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:16.993012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:16.993278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] PATH_INFO: `/v3/projects/8669fceab64144828ca5aab86b8f39b6/users/ed492b61eb0e44c8b5ab7caf5cd2507c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.008176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8669fceab64144828ca5aab86b8f39b6, user_id=ed492b61eb0e44c8b5ab7caf5cd2507c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.010833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7826089-53b3-4a2b-8a62-abe868a9293f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.040398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 983/1965] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:16 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:17.044649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.054852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf855215-8636-4903-bc54-7da1a7d847bf admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.060301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.061213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.061657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.062073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.062945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.064544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.078617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 984/1966] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:17.079629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.090570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd55c6-45b4-46d7-ab49-b41c3fce9d8a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.100752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 983/1967] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:16 2022] PUT /identity/v3/projects/8669fceab64144828ca5aab86b8f39b6/users/ed492b61eb0e44c8b5ab7caf5cd2507c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:17.113623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.114037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.114437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.159834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] MFA Rules not processed for user `ed492b61eb0e44c8b5ab7caf5cd2507c`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:17.162074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.162669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.162981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.163256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.163525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] PATH_INFO: `/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e/users/d4525299f65b4591b4321388234a4ae1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.180313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3f52c0d0ed44bfa0c3700ff86f949e, user_id=d4525299f65b4591b4321388234a4ae1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.183012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.230269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 984/1968] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:17.241084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.242486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.274295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 985/1969] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:17 2022] PUT /identity/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e/users/d4525299f65b4591b4321388234a4ae1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:17.279631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.311871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f836242-e837-4612-bcc4-9fcb32ddad59 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.363104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c25c-fde6-4afa-9cb8-cbeba2ba9e99 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.368892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.369502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.369775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.369884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.370040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.370423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.370705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.375894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.376008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.376095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.382254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 986/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:17.386325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.388754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.401869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63dc1c-8067-48a1-9aa1-5bbcff57fead admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.407483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.408099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.408373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.408643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] PATH_INFO: `/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.409753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e23b9c2f454a63a7bdf1a476fa1519)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.411652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.429292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.430960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.440465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 985/1971] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:17.441225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.452336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2540-0538-48e5-9003-56770731a3b1 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.457612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.461974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.461974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.461974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] PATH_INFO: `/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e/users/d4525299f65b4591b4321388234a4ae1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.461974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3f52c0d0ed44bfa0c3700ff86f949e, user_id=d4525299f65b4591b4321388234a4ae1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.463824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f97ee2-cf6c-4eab-a04b-56577c35381f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.474436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 986/1972] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:17 2022] PUT /identity/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e/users/d4525299f65b4591b4321388234a4ae1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:17.485955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.486295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.486576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.514990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] MFA Rules not processed for user `d4525299f65b4591b4321388234a4ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:17.516226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.530793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e23b9c2f454a63a7bdf1a476fa1519', 'request_id': 'req-63f13ed5-959d-4ff3-a200-3e7f6e35e409'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.539140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e23b9c2f454a63a7bdf1a476fa1519', 'request_id': 'req-63f13ed5-959d-4ff3-a200-3e7f6e35e409'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.540955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:17.591930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 987/1973] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:17.602679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.604263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.622900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e23b9c2f454a63a7bdf1a476fa1519', 'request_id': 'req-63f13ed5-959d-4ff3-a200-3e7f6e35e409'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.636650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] The token cache is being invalidate because project 43e23b9c2f454a63a7bdf1a476fa1519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:17.637343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.638088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-63f13ed5-959d-4ff3-a200-3e7f6e35e409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:17.640237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 987/1974] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:17 2022] DELETE /identity/v3/projects/43e23b9c2f454a63a7bdf1a476fa1519 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:17.645207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.645494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.645760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.666113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:17.666705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a2b5a-aa48-468e-8bf6-417ae4cdf231 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.671172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.671798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.672083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.672353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.673167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:17.674298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.674418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.693815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.695350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d873835-be66-44b0-afe0-72d87d07a504 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.705406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 988/1975] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:17.735724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 988/1976] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:17.743781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.744199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.744477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.764310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:17.765969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:17.773868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 989/1977] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:17.778752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.788306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c351f0-b0b6-401b-a042-6cbbccf42b22 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.794664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.795026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.795307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.795968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.796262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:17.796500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.798086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.809857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 989/1978] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:17.814375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.825237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f2aa-7902-46f8-880b-e7b00965523f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:17.830505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:17.831197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:17.831546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:17.831894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:17.832763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:17.834817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:17.964297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 990/1979] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:17.968746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:17.986940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936909-533e-47af-a0cc-9880b4215376 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.056897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.057588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.057809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.058367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.058733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.060708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.189209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 990/1980] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:17 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:18.193395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.204576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef868854-8eed-4401-bc98-c810b7f85147 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.209150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.209746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.210026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.210379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.211113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.212875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.217369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:18.227354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 991/1981] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:18.231993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.243685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c60293-de86-4aa5-a4fc-152bd2e90ee1 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.249373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.250250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.250716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.251199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.251893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.254012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826de2c-4066-4022-8aae-a033113c7ba4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.265713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 991/1982] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:18.270049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.280790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a172f5-61eb-40c3-ba87-0785450dcb4c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.287764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.288528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.288775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.289050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] PATH_INFO: `/v3/projects/cbd24f26eaa54d0a8d1e2f6d5908dfda/users/e40c88c8f43346d8bc4d1169efe7dd74/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.296431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:18.304925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd24f26eaa54d0a8d1e2f6d5908dfda, user_id=e40c88c8f43346d8bc4d1169efe7dd74, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.307671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.464178 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 992/1983] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:18 2022] PUT /identity/v3/projects/cbd24f26eaa54d0a8d1e2f6d5908dfda/users/e40c88c8f43346d8bc4d1169efe7dd74/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:18.474022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19ce0-0529-4690-be74-bf56182aa1a2 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.474339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19ce0-0529-4690-be74-bf56182aa1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.474616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f19ce0-0529-4690-be74-bf56182aa1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.502169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-23f19ce0-0529-4690-be74-bf56182aa1a2 None None] MFA Rules not processed for user `e40c88c8f43346d8bc4d1169efe7dd74`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:18.503403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-23f19ce0-0529-4690-be74-bf56182aa1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.571267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 992/1984] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:18.582934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:18.584259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:18.586010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:18.640065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:18.664129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bbd57-231c-4e8d-ab2d-3ae10230c67f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:18.667826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:18.669024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:18.669296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:18.669567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:18.677662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:18.679253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:18.689110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 993/1985] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:18.948560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:19.578247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e2aa6-9077-4586-9b46-724104013d62 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:19.579085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e2aa6-9077-4586-9b46-724104013d62 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:19.579579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e2aa6-9077-4586-9b46-724104013d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:19.621904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7f4e2aa6-9077-4586-9b46-724104013d62 None None] MFA Rules not processed for user `ed492b61eb0e44c8b5ab7caf5cd2507c`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:19.621904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7f4e2aa6-9077-4586-9b46-724104013d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:19.686335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 993/1986] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:22.277902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:22.279564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.345073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819431-f242-4e1c-b6cf-f2dd7ad63a5b service glance] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.349544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.350225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.350508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.350778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] PATH_INFO: `/v3/users/a37f9f2b3df64c46a67f3955ea73ca76` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.351877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37f9f2b3df64c46a67f3955ea73ca76)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.354073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.539963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37f9f2b3df64c46a67f3955ea73ca76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.555458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37f9f2b3df64c46a67f3955ea73ca76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.558079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:22.657395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37f9f2b3df64c46a67f3955ea73ca76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.658809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37f9f2b3df64c46a67f3955ea73ca76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.659535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37f9f2b3df64c46a67f3955ea73ca76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:22.673480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 994/1987] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:22 2022] DELETE /identity/v3/users/a37f9f2b3df64c46a67f3955ea73ca76 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:22.678101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.678643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.678901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.698805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:22.700188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.783095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 994/1988] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:22.791994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:22.796866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:22.882914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642729-c396-42b8-aa13-5e64014b7779 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:22.890171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:22.890858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:22.891161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:22.891406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:22.917192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:22.917192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:22.925611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 995/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:23.405054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.406223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:23.419691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e24de-541e-4a06-992b-aec865b0f9db None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:23.425334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:23.426258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.426872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.427294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] PATH_INFO: `/v3/projects/f70451d5c75d4b9b851793311cd46603` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.430093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70451d5c75d4b9b851793311cd46603)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:23.430571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:23.461496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:23.563926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70451d5c75d4b9b851793311cd46603', 'request_id': 'req-4c6a9284-d00b-49b8-818e-45ce9842f51a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.571784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70451d5c75d4b9b851793311cd46603', 'request_id': 'req-4c6a9284-d00b-49b8-818e-45ce9842f51a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.720375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70451d5c75d4b9b851793311cd46603', 'request_id': 'req-4c6a9284-d00b-49b8-818e-45ce9842f51a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.733323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] The token cache is being invalidate because project f70451d5c75d4b9b851793311cd46603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:23.733607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.734578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:23.736332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 995/1990] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/projects/f70451d5c75d4b9b851793311cd46603 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:23.740303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:23.751272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c52ea-908a-4e59-9789-ca466241aaa6 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:23.825327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:23.826542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:23.826856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:23.827238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] PATH_INFO: `/v3/users/d4525299f65b4591b4321388234a4ae1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:23.828477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4525299f65b4591b4321388234a4ae1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:23.830544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.136835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4525299f65b4591b4321388234a4ae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.153990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4525299f65b4591b4321388234a4ae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.250746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4525299f65b4591b4321388234a4ae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.252249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4525299f65b4591b4321388234a4ae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.252249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4525299f65b4591b4321388234a4ae1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:24.265864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 996/1991] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:23 2022] DELETE /identity/v3/users/d4525299f65b4591b4321388234a4ae1 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:24.752023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.753514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.777301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:24.777301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:24.787426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:24.808369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a9284-d00b-49b8-818e-45ce9842f51a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.862088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706dfe3-cf56-49f3-b0a2-4e6c24e1176a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:24.867460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.868993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.868993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.868993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] PATH_INFO: `/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.873355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3f52c0d0ed44bfa0c3700ff86f949e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.875552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:24.895648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:24.896731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:24.897651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:24.898285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] PATH_INFO: `/v3/users/d4826a85c79a42e89f9cd236e27f54be` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:24.899800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4826a85c79a42e89f9cd236e27f54be)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:24.903759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.215756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4826a85c79a42e89f9cd236e27f54be'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.216572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3f52c0d0ed44bfa0c3700ff86f949e', 'request_id': 'req-2c697c40-8301-4d2f-81ff-4735161c2d78'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.221693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4826a85c79a42e89f9cd236e27f54be'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.258471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4826a85c79a42e89f9cd236e27f54be'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.354742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3f52c0d0ed44bfa0c3700ff86f949e', 'request_id': 'req-2c697c40-8301-4d2f-81ff-4735161c2d78'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.363665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3f52c0d0ed44bfa0c3700ff86f949e', 'request_id': 'req-2c697c40-8301-4d2f-81ff-4735161c2d78'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.375793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] The token cache is being invalidate because project 6b3f52c0d0ed44bfa0c3700ff86f949e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:25.376107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.377425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2c697c40-8301-4d2f-81ff-4735161c2d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.379311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 997/1992] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:24 2022] DELETE /identity/v3/projects/6b3f52c0d0ed44bfa0c3700ff86f949e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:25.384204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec177-5eda-46bf-9d23-be358d9a6a3d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.384970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec177-5eda-46bf-9d23-be358d9a6a3d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.384970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec177-5eda-46bf-9d23-be358d9a6a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.406950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-724ec177-5eda-46bf-9d23-be358d9a6a3d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.408223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-724ec177-5eda-46bf-9d23-be358d9a6a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.416627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4826a85c79a42e89f9cd236e27f54be'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.419446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3c553fd3-ac42-4936-aa10-e242d54293f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4826a85c79a42e89f9cd236e27f54be'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:25.437352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 996/1993] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:24 2022] DELETE /identity/v3/users/d4826a85c79a42e89f9cd236e27f54be => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:25.441650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.441933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.442239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.462906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.464116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.480242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 998/1994] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:25.487861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.489621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.489621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.501600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:25.511574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:25.513997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.542075 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 997/1995] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:25.549443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.551192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:25.604079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 999/1996] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:25.605108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.616887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e21c85-2080-481e-b24b-c6bcb55579b5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.629230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.633494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.633494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.633494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.633494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:25.633494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.635762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.636352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c26a-0aa7-4288-aa8f-626c5aed403f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.641157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.641804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.642087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.642531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.663391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.664895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.669218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1000/1997] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:25.671152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.679808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 998/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:25.687006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afafed-875c-4774-b3b5-775dfc05476b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.693451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.694351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.694775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.695197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.696488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.698781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:25.778969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:25.824173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1001/1999] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:25.828503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:25.839472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4230eb-79d0-45f5-8ee7-50b665345a43 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:25.928249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:25.928863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:25.929315 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:25.930667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:25.930667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:25.932309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.042007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 999/2000] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:25 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:26.046877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.062781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528860-b0e7-4696-a18f-d0d46922d756 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.077432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.078240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.078530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.078800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.079454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.081122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.106660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1002/2001] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.110787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.131318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0ed5-8051-4975-a739-a756f00069ff admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.148237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.148855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.149187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.149468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.150108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.154436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03893d48-8f15-463e-8996-51b7a2aaf14c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.166301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1000/2002] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:26.170647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.181384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e5d9d-0179-4c6f-8a6a-cec272ab1dd1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.197742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.198797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.206427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.206427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] PATH_INFO: `/v3/projects/e1635426d08e48919296168b3edb3eb6/users/921a4d3a2fc04fc79b22f65e04cb2e3d/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.219120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1635426d08e48919296168b3edb3eb6, user_id=921a4d3a2fc04fc79b22f65e04cb2e3d, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.222026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.331329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1003/2003] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:26 2022] PUT /identity/v3/projects/e1635426d08e48919296168b3edb3eb6/users/921a4d3a2fc04fc79b22f65e04cb2e3d/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:26.342208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.342500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.342777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.385213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] MFA Rules not processed for user `921a4d3a2fc04fc79b22f65e04cb2e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:26.386563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.480932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:26.484004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1001/2004] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:26.494370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.497657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.620459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad0f5-d4b5-437a-a711-05aa39d9bb71 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.625083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.625717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.625997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.626306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.635702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.637139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.647828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1004/2005] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:26.669478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.681635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:26.683704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:26.767071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbe5e9-e6cd-4c62-b81a-1c4247cb5b0c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.780482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.781134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.781416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.781687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] PATH_INFO: `/v3/users/921a4d3a2fc04fc79b22f65e04cb2e3d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.784521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] RBAC: Authorizing `identity:delete_user(user_id=921a4d3a2fc04fc79b22f65e04cb2e3d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.786485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.835361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990cc9f-dfad-4ee8-8dc5-c548547d8032 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:26.850170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:26.850850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:26.851124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:26.851393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] PATH_INFO: `/v3/projects/c049ff885f384f758aea657af1f93482` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:26.853400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c049ff885f384f758aea657af1f93482)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:26.857610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:26.873185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:27.026557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921a4d3a2fc04fc79b22f65e04cb2e3d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.027210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921a4d3a2fc04fc79b22f65e04cb2e3d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.030774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c049ff885f384f758aea657af1f93482', 'request_id': 'req-d2798add-69b0-4d25-812a-664407f3076c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.040088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921a4d3a2fc04fc79b22f65e04cb2e3d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.138732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c049ff885f384f758aea657af1f93482', 'request_id': 'req-d2798add-69b0-4d25-812a-664407f3076c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.146881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c049ff885f384f758aea657af1f93482', 'request_id': 'req-d2798add-69b0-4d25-812a-664407f3076c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.158798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] The token cache is being invalidate because project c049ff885f384f758aea657af1f93482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:27.159043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.159696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.161425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1005/2006] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:26 2022] DELETE /identity/v3/projects/c049ff885f384f758aea657af1f93482 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:27.165124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.166673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.240814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798add-69b0-4d25-812a-664407f3076c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.246934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.247672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.248027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.248376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] PATH_INFO: `/v3/users/f0acdb0f5c954dd79d686f64f97b9724` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.250674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0acdb0f5c954dd79d686f64f97b9724)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.251400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921a4d3a2fc04fc79b22f65e04cb2e3d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.252188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5c88466c-f87e-4e10-962e-d2b09b5f876a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921a4d3a2fc04fc79b22f65e04cb2e3d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.252903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.269726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1002/2007] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:26 2022] DELETE /identity/v3/users/921a4d3a2fc04fc79b22f65e04cb2e3d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:27.275638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.279843 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.280390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.326149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:27.327672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.475403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1003/2008] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:27.495634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:27.497158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:27.504375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:27.529677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0acdb0f5c954dd79d686f64f97b9724'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.555251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0acdb0f5c954dd79d686f64f97b9724'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.601917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b912a-6124-47b1-b75a-2e0d62d9669d None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:27.606904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:27.610981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:27.610981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:27.610981 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:27.618371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:27.620117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:27.636211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1004/2009] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:27.650717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0acdb0f5c954dd79d686f64f97b9724'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.651544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0acdb0f5c954dd79d686f64f97b9724'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.652351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0acdb0f5c954dd79d686f64f97b9724'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:27.670748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1006/2010] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:27 2022] DELETE /identity/v3/users/f0acdb0f5c954dd79d686f64f97b9724 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:28.498943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.501033 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.531360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8566b-fc0a-4eb7-a812-1525d164823f service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.635770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.636413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.638109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.638855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] PATH_INFO: `/v3/projects/e1635426d08e48919296168b3edb3eb6` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.639792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1635426d08e48919296168b3edb3eb6)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.641698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.675870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:28.677207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:28.701851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5259b-4e59-4e1c-896b-a40aa8a2fcac admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:28.712743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:28.713549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:28.713778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:28.714290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] PATH_INFO: `/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:28.716721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8787cef29e74beeac6f05f0b4c1e29e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:28.723936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:28.738379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:28.840388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1635426d08e48919296168b3edb3eb6', 'request_id': 'req-bf1fded2-8f59-4872-8cd4-310b58774f69'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.853331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1635426d08e48919296168b3edb3eb6', 'request_id': 'req-bf1fded2-8f59-4872-8cd4-310b58774f69'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.908501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8787cef29e74beeac6f05f0b4c1e29e', 'request_id': 'req-8b3dd706-30c3-4668-96fd-9a120c7913a0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:28.988218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1635426d08e48919296168b3edb3eb6', 'request_id': 'req-bf1fded2-8f59-4872-8cd4-310b58774f69'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.001213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] The token cache is being invalidate because project e1635426d08e48919296168b3edb3eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:29.001509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.002172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf1fded2-8f59-4872-8cd4-310b58774f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.003711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1005/2011] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:28 2022] DELETE /identity/v3/projects/e1635426d08e48919296168b3edb3eb6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:29.008655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fcca-6b98-4762-9a4f-2aef4ba4a622 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.009104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fcca-6b98-4762-9a4f-2aef4ba4a622 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.009245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fcca-6b98-4762-9a4f-2aef4ba4a622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.079696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8787cef29e74beeac6f05f0b4c1e29e', 'request_id': 'req-8b3dd706-30c3-4668-96fd-9a120c7913a0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.088168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8787cef29e74beeac6f05f0b4c1e29e', 'request_id': 'req-8b3dd706-30c3-4668-96fd-9a120c7913a0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.089284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-cd39fcca-6b98-4762-9a4f-2aef4ba4a622 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.090862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cd39fcca-6b98-4762-9a4f-2aef4ba4a622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.110958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] The token cache is being invalidate because project f8787cef29e74beeac6f05f0b4c1e29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:29.112741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.118306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b3dd706-30c3-4668-96fd-9a120c7913a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:29.120816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1007/2012] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:28 2022] DELETE /identity/v3/projects/f8787cef29e74beeac6f05f0b4c1e29e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:29.127088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed62cf-e90f-42ba-b21f-2179a2f74a30 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.127700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed62cf-e90f-42ba-b21f-2179a2f74a30 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.128184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed62cf-e90f-42ba-b21f-2179a2f74a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.169452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-17ed62cf-e90f-42ba-b21f-2179a2f74a30 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.171147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-17ed62cf-e90f-42ba-b21f-2179a2f74a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.215829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1006/2013] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:29.225452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.226004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.226671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.285178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:29.290521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.293861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.308166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1007/2014] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:29.312261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.343336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ccdc-a2b6-42b7-b288-99182173df45 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.349970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.351026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.351310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.351578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.351690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1008/2015] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:29.352238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:29.352541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.353900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.354211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.354862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.379167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.380697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.380816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.394224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1009/2016] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:29.395870 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.402086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1008/2017] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:29.412434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90872a-b909-4742-bf8d-bcadd98018f4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.412758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.417459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.418096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.418408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.418683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.419326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:29.419627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.421226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.425984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514832-7454-4650-a2d9-7ce08e6f4931 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.430975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.431652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.432005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.432541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.433236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.437676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1010/2018] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:29.437808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f185e-8c81-4ef5-a643-fa2a2185c816 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.438787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.454923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dea57-fc06-47e6-af7b-b9829e896b2e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.460224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.460842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.461118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.461413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.462056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.463981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f1866-a86a-4ae2-81c2-7ce6ca92473c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.624170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1009/2019] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:29.625430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c15b3-8df7-4fae-87d0-71b022cd6c20 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.631548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c15b3-8df7-4fae-87d0-71b022cd6c20 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.631548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c15b3-8df7-4fae-87d0-71b022cd6c20 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.631548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1010/2020] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:48:29.631548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c15b3-8df7-4fae-87d0-71b022cd6c20 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.687063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1011/2021] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/projects => generated 363 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:29.689060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.689449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.689729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.697103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c15b3-8df7-4fae-87d0-71b022cd6c20 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.709982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:29.711165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.767710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.768714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.769104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.769790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.770605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.775741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.784502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1012/2022] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:29.785664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.796271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb09d71-dab2-4e9d-add1-1293f46b4e36 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.800869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.801482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.801761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.802033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.802682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.804765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.868480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1011/2023] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:29.869470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.871105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.883312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ae1ca-f15c-4d09-b388-a56b8d59172b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.888019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.888628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.888906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.889170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] PATH_INFO: `/v3/users/56a8835b7a764c65820758eaf7accbbe` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.890334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a8835b7a764c65820758eaf7accbbe)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.892274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.910449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1013/2024] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:29 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:29.910819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.912394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:29.927267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506452a7-73e6-4093-91eb-aff07dd9adf2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.932294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.932893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.933174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.934787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.942256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.943829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.953215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1014/2025] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:29.954058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.965085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58fe1-5f79-4f38-9e2a-0bae0255687a service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:29.969708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:29.970378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:29.970670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:29.973191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:29.973191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:29.973399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:29.988751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1015/2026] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:29.988751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:29.997334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c320589-6bec-4203-8ffa-97316e35c299 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.001959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.002572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.002854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.003124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.003750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.005322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.014946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1016/2027] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:30.015855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.025095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aacbdf-c357-407d-a5f0-96acef9c3425 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.030030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.030251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.030532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.030822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.031402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.032922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.046348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1017/2028] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:30.046348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.054886 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66753b-13bf-474a-86bf-447450c35c86 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.060523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.061142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.061422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.061717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.062389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.064052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.074388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1018/2029] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:30.075145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.084279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b68491-1641-4289-a221-9145d7d3a43e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.088915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.089587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.089861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.090133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] PATH_INFO: `/v3/projects/548eafb01e38493da73af70ed61c7759/users/3996b0e9c0aa4d6080d8b2a08fedd6b9/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.104478 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=548eafb01e38493da73af70ed61c7759, user_id=3996b0e9c0aa4d6080d8b2a08fedd6b9, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.107719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.117721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a8835b7a764c65820758eaf7accbbe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.118997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a8835b7a764c65820758eaf7accbbe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.133237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a8835b7a764c65820758eaf7accbbe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.195844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1019/2030] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:30 2022] PUT /identity/v3/projects/548eafb01e38493da73af70ed61c7759/users/3996b0e9c0aa4d6080d8b2a08fedd6b9/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:30.196661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.206666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.224790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a8835b7a764c65820758eaf7accbbe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.226703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9698b568-63e8-491e-b5bc-d63ca8308997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a8835b7a764c65820758eaf7accbbe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.242290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1012/2031] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:29 2022] DELETE /identity/v3/users/56a8835b7a764c65820758eaf7accbbe => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:30.243677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.243956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.244224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.279806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] MFA Rules not processed for user `3996b0e9c0aa4d6080d8b2a08fedd6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:30.281025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.308022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329be9-f88e-4a73-8a2e-934533f92d3b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.359327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1013/2032] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:30.369661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.371676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.381411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.382499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.382813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.387331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] PATH_INFO: `/v3/projects/d1ed3d88975845f38359bff951b126f8/users/a918cb892be245bd92ffc776af734aa5/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.402850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed3d88975845f38359bff951b126f8, user_id=a918cb892be245bd92ffc776af734aa5, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.407649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.451970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100997f1-a27e-42cc-9391-2c1bf31dc3b2 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.457932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.457932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.457932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.458431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.473102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.474646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d82a9-db96-4acb-bd89-3b33657aad17 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.486426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1014/2033] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:30.493736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1020/2034] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:30 2022] PUT /identity/v3/projects/d1ed3d88975845f38359bff951b126f8/users/a918cb892be245bd92ffc776af734aa5/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:30.509172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.509677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.509956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.550650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] MFA Rules not processed for user `a918cb892be245bd92ffc776af734aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:30.552276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.565790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:30.641427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1015/2035] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:30.645806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.716043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05effb65-f72c-464c-b34c-ede7f858924c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.721086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.721724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.722004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.722310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.722949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.724974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.762139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.763768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:30.791276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089cf2e-fee3-46c6-9832-abf202c7dd20 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.797290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.798269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.798552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.799014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] PATH_INFO: `/v3/projects/5574355e5db64af7bf6a0469c29f5569` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.800344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5574355e5db64af7bf6a0469c29f5569)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.802437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.854784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1021/2036] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:30.858999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:30.935030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff779a26-3a8e-4460-bc6b-011593ce0cec admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:30.941717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:30.942368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:30.942649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:30.942915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:30.943678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:30.945831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:30.982152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5574355e5db64af7bf6a0469c29f5569', 'request_id': 'req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:30.997206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5574355e5db64af7bf6a0469c29f5569', 'request_id': 'req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.102641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1022/2037] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:30 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:31.107332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.107669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5574355e5db64af7bf6a0469c29f5569', 'request_id': 'req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.115493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0ad6-e2fc-4865-b1bc-03dfd65055a2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.132737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] The token cache is being invalidate because project 5574355e5db64af7bf6a0469c29f5569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:31.133287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.135976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1cd98d4a-79c7-433f-b447-4f91c9a4f7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:31.137885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1016/2038] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:30 2022] DELETE /identity/v3/projects/5574355e5db64af7bf6a0469c29f5569 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:31.142136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf25bb-ac0d-4298-97ad-db77ea32e8a7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.143128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf25bb-ac0d-4298-97ad-db77ea32e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.143535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf25bb-ac0d-4298-97ad-db77ea32e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.164163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0fdf25bb-ac0d-4298-97ad-db77ea32e8a7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:31.165766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0fdf25bb-ac0d-4298-97ad-db77ea32e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.196519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.197163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.197508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.197816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.198543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.200756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.216935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1023/2039] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:31.218122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.221676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.236030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00dfad-77c5-4f05-bd5d-0b20179d0694 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.246870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1017/2040] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:31.246870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:31.247115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.247115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.247115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.247115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] PATH_INFO: `/v3/projects/52ccbe596a704afa9dfd28226349c5a6/users/5744970429cd460e857f44143f9064c9/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.248799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.249080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.254811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.267559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ccbe596a704afa9dfd28226349c5a6, user_id=5744970429cd460e857f44143f9064c9, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.270519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.288015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:31.289464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.314227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1018/2041] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:31.319269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.331144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415d5df-d791-4ce4-936a-e896c35fc088 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.335724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.336327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.336603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.338764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.338764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:31.338764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.339371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.351091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1019/2042] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:31.358494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.362732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1024/2043] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:31 2022] PUT /identity/v3/projects/52ccbe596a704afa9dfd28226349c5a6/users/5744970429cd460e857f44143f9064c9/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:31.368474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.384089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3a75-8318-4001-9437-165e5e447d94 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.453221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd449-b688-47aa-ad69-c8840ea05c02 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.454741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.455462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.455744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.456019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.456738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.458117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.458724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.458837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.459020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.459311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.459963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.461607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.483529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1025/2044] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:31.485163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.499011 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cef3c-ca09-4fbb-8a0d-01ebdd4e1201 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.504250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.505065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.505254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.505454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] PATH_INFO: `/v3/projects/52ccbe596a704afa9dfd28226349c5a6/users/5744970429cd460e857f44143f9064c9/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.510553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ccbe596a704afa9dfd28226349c5a6, user_id=5744970429cd460e857f44143f9064c9, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.517509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15efe1-f85b-475e-8df0-5802a1441601 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.529559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1026/2045] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:31 2022] PUT /identity/v3/projects/52ccbe596a704afa9dfd28226349c5a6/users/5744970429cd460e857f44143f9064c9/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:31.542776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.543700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.543910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.561529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1020/2046] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:31.567284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.575499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] MFA Rules not processed for user `5744970429cd460e857f44143f9064c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:31.576712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.648155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a753b0-7351-4fcb-93ce-50092231b75c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.655848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.658577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.658577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.658577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.658854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.661127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.662330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1027/2047] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:31.678546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.681515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:31.745960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc8a2-2ef5-41ac-af0f-b08d406730f3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.751043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.751657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.751937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.752216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.764338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.766480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.780282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1028/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:31.834221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1021/2049] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:31 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:31.838326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.849856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b493dca-3dd6-4175-8163-031a9aceaa03 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.860369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.860369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.860369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.860369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.860846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.860846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.873472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1029/2050] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:31.874670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.885937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9735-dc08-4895-b13f-7c8317f9476a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.890719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.891328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.891607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.891906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.892549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.894151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022357bb-0691-41e2-80a5-7cd7bc6e3527 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:31.905228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1022/2051] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:31.910069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:31.921181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193a603-fdf2-4f7b-ad11-6f7273f58907 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:31.925837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:31.926528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:31.926809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:31.927083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] PATH_INFO: `/v3/projects/9f1bfa04c85d400ea13270dbda5c1d86/users/872be1e79634406dbe92acc794fadb82/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:31.941755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1bfa04c85d400ea13270dbda5c1d86, user_id=872be1e79634406dbe92acc794fadb82, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:31.944493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.045853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1030/2052] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:31 2022] PUT /identity/v3/projects/9f1bfa04c85d400ea13270dbda5c1d86/users/872be1e79634406dbe92acc794fadb82/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:32.056007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.056290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.056558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.083862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] MFA Rules not processed for user `872be1e79634406dbe92acc794fadb82`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:32.085061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.148257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1023/2053] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:32.160461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.162157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:32.236383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ea78b-8613-4b14-9ab2-ba446dae5cdb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.242286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.242888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.244536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.244821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.252918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.254540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.264291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1031/2054] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:32.583394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:32.662646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4ddf9-6216-4040-932d-e6dc2561dcd1 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:32.668711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:32.669362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:32.669694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:32.669907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] PATH_INFO: `/v3/users/872be1e79634406dbe92acc794fadb82` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:32.671077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872be1e79634406dbe92acc794fadb82)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:32.672985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:32.748640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:32.977773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872be1e79634406dbe92acc794fadb82'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.978784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872be1e79634406dbe92acc794fadb82'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:32.991292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872be1e79634406dbe92acc794fadb82'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.108923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872be1e79634406dbe92acc794fadb82'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.109668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-772a0e1e-cd9f-4d7f-b230-bccfb2553408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872be1e79634406dbe92acc794fadb82'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.115786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.144278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1024/2055] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:32 2022] DELETE /identity/v3/users/872be1e79634406dbe92acc794fadb82 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:33.144469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e227aab-c039-4be6-ac07-8282d9acb825 service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.147290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.147290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.147290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.185372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:33.186658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.237240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.237889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.238221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.238672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] PATH_INFO: `/v3/users/a918cb892be245bd92ffc776af734aa5` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.239956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a918cb892be245bd92ffc776af734aa5)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.242034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.256412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1025/2056] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:33.268070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.269912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.332251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bf43b-7d20-48e1-bc84-2f2882144c7f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.336898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:33.339282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.340027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.340452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.340796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.351287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.352890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8ee6-2867-451b-86c0-8e562e77f9f5 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.366537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1026/2057] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:33.434205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a918cb892be245bd92ffc776af734aa5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.460007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a918cb892be245bd92ffc776af734aa5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.554718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a918cb892be245bd92ffc776af734aa5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.555405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a918cb892be245bd92ffc776af734aa5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.560204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a918cb892be245bd92ffc776af734aa5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:33.575615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1032/2058] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:33 2022] DELETE /identity/v3/users/a918cb892be245bd92ffc776af734aa5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:33.580021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.580345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.580673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.601562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:33.603486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.666617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1027/2059] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:33.675945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:33.677344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:33.735937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da2684-d965-4c86-94d7-63a796768a77 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:33.746843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:33.746843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:33.746843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:33.746843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:33.751173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:33.752667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8276-3e6c-4d9f-bd29-7715bcc5c3bc service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:33.764337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1033/2060] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:34.024205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.025777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.039268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852cb7-c065-499b-b7d5-61ef7d8d8ad7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.051859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.052628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.053111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.053486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] PATH_INFO: `/v3/projects/9f1bfa04c85d400ea13270dbda5c1d86` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.054740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1bfa04c85d400ea13270dbda5c1d86)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.056779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.171392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1bfa04c85d400ea13270dbda5c1d86', 'request_id': 'req-bac78a4f-7421-413b-89fa-b8f5a425e795'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.177666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1bfa04c85d400ea13270dbda5c1d86', 'request_id': 'req-bac78a4f-7421-413b-89fa-b8f5a425e795'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.256427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1bfa04c85d400ea13270dbda5c1d86', 'request_id': 'req-bac78a4f-7421-413b-89fa-b8f5a425e795'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.268924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] The token cache is being invalidate because project 9f1bfa04c85d400ea13270dbda5c1d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:34.269214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.269879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.271407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1028/2061] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:34 2022] DELETE /identity/v3/projects/9f1bfa04c85d400ea13270dbda5c1d86 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:34.276260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf3d8-c87e-41f6-8fc7-1ace26aa51c5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.276560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf3d8-c87e-41f6-8fc7-1ace26aa51c5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.276818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf3d8-c87e-41f6-8fc7-1ace26aa51c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.286687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:34.296171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.297721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.299749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2caaf3d8-c87e-41f6-8fc7-1ace26aa51c5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:34.306701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2caaf3d8-c87e-41f6-8fc7-1ace26aa51c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.366728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac78a4f-7421-413b-89fa-b8f5a425e795 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.371835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1034/2062] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:34.371960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.372466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.372770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.373162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] PATH_INFO: `/v3/projects/d1ed3d88975845f38359bff951b126f8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.374325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ed3d88975845f38359bff951b126f8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.376234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.380461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.380857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.381312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.402741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:34.403981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.411968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1035/2063] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:34.416200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.425473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56349f58-1f80-4fe3-a5cf-25d49e628c70 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.430128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.430923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.431099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.431288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.431911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:34.432201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.434455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.445949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1036/2064] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:34.449965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.459287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d9bd-e08b-4dbe-8bd4-3b7df7ae0b0b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.463891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.464447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.464765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.465037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.465631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.467507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.502596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ed3d88975845f38359bff951b126f8', 'request_id': 'req-0fae961b-481f-4657-963e-82f346cc2df9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.508662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ed3d88975845f38359bff951b126f8', 'request_id': 'req-0fae961b-481f-4657-963e-82f346cc2df9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.549944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1037/2065] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:34 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:34.553924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.616189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ed3d88975845f38359bff951b126f8', 'request_id': 'req-0fae961b-481f-4657-963e-82f346cc2df9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.616446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36d28-86c8-4aec-9a58-ee3276dad6e9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.623022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.623587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.623995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.624144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.624774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.626746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.628634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] The token cache is being invalidate because project d1ed3d88975845f38359bff951b126f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:34.628921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.629674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:34.631458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1029/2066] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:34 2022] DELETE /identity/v3/projects/d1ed3d88975845f38359bff951b126f8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:34.635313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.636714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.707281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae961b-481f-4657-963e-82f346cc2df9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.714197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.715965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.716248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.716521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] PATH_INFO: `/v3/users/5744970429cd460e857f44143f9064c9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.717685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5744970429cd460e857f44143f9064c9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.719756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.746982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1038/2067] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:34 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:34.754455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.754455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:34.765857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cbd04-bae6-41b0-a9f0-904857e8b94f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.770716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.771324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.771597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.773020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.773020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.774061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.784455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1039/2068] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:34.788337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.798248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e3b9d-73fd-4f35-bc9a-6fc9a918a831 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.802868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.803417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.803693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.803963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.804565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.806079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.816712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1040/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:34.820768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:34.830261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af728a-30f7-4047-8045-d9e29c77f87f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:34.834937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:34.835548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.835822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.836092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] PATH_INFO: `/v3/projects/f520f22617fa411a8ef60bde586775a3/users/cc1c398336234105b9ed8ab256b7c7af/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.850590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f520f22617fa411a8ef60bde586775a3, user_id=cc1c398336234105b9ed8ab256b7c7af, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:34.853453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28914d9-9b75-4e7d-90d2-4725556398f7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:34.949180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1041/2070] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:34 2022] PUT /identity/v3/projects/f520f22617fa411a8ef60bde586775a3/users/cc1c398336234105b9ed8ab256b7c7af/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:34.960003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:34.960285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:34.960551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:34.988505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] MFA Rules not processed for user `cc1c398336234105b9ed8ab256b7c7af`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:34.989695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:35.052422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1042/2071] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:35.057163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.120426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff480e-1297-4348-b5da-16d76a564513 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.125038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.125641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.125945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.126249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.126874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.128777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.275724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5744970429cd460e857f44143f9064c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:35.276376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5744970429cd460e857f44143f9064c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:35.288105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5744970429cd460e857f44143f9064c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:35.298821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1043/2072] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:35 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:35.302681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.304361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:35.368007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a557e-c8e8-4743-9a91-e2e976fd992a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.373282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.373880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.374161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.374467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.375156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.377118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.393287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5744970429cd460e857f44143f9064c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:35.393920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5744970429cd460e857f44143f9064c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:35.407444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1030/2073] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:34 2022] DELETE /identity/v3/users/5744970429cd460e857f44143f9064c9 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:35.462902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1044/2074] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:35 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:35.467188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.528973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4f76d-6b99-49f4-aab5-f1a6456d8282 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.536402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.537012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.537293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.537573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.538243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.539851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.552508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1031/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:35.556765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.567218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0944-62cd-421f-9f2a-e15b234042e6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.572168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.574968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.574968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.574968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] PATH_INFO: `/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4/users/6ee350f470184f2e9c41dcf395bf706c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.588497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3921d7dc8149818f33f5f751a1b1a4, user_id=6ee350f470184f2e9c41dcf395bf706c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.591878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.645477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:35.690850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1045/2076] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:35 2022] PUT /identity/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4/users/6ee350f470184f2e9c41dcf395bf706c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:35.694905 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.706354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa088ea1-ffa2-49ee-9c8d-6c2bcd9fb250 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.764871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.773695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.773695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.773695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.773695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.773695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01716f5-96dd-4f02-87e6-bfdb70f0283e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.779354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1032/2077] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:35.787522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.798735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a531c-8bc5-44cf-bb04-805ac56dfbb0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.803442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.804218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.804496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.804789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] PATH_INFO: `/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4/users/6ee350f470184f2e9c41dcf395bf706c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.806724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3921d7dc8149818f33f5f751a1b1a4, user_id=6ee350f470184f2e9c41dcf395bf706c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.810102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.822052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1046/2078] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:35 2022] PUT /identity/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4/users/6ee350f470184f2e9c41dcf395bf706c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:35.832961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.833333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.833723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.859209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.862796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:35.865407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] MFA Rules not processed for user `6ee350f470184f2e9c41dcf395bf706c`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:35.866732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:35.944573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd0aa6-e0c4-41be-82fe-98c04b5ed058 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:35.949694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:35.951038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:35.951420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:35.951794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] PATH_INFO: `/v3/projects/52ccbe596a704afa9dfd28226349c5a6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:35.953068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ccbe596a704afa9dfd28226349c5a6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:35.955032 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:35.958748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1033/2079] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:35.976024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:35.977417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:35.982771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:36.034230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ff01d-30eb-457c-8aff-90e96c35794b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.037758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.038400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.038674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.038941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.047677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.049078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada5ab6-427b-4a4f-b425-dd34ac4ba908 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.058437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1034/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:36.067844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ccbe596a704afa9dfd28226349c5a6', 'request_id': 'req-a8a726c1-700a-4085-b938-dbfeacd326ea'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.136136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ccbe596a704afa9dfd28226349c5a6', 'request_id': 'req-a8a726c1-700a-4085-b938-dbfeacd326ea'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.143309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ccbe596a704afa9dfd28226349c5a6', 'request_id': 'req-a8a726c1-700a-4085-b938-dbfeacd326ea'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.154235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] The token cache is being invalidate because project 52ccbe596a704afa9dfd28226349c5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:36.154527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.155203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:36.156722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1047/2081] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:35 2022] DELETE /identity/v3/projects/52ccbe596a704afa9dfd28226349c5a6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:36.161651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd3c3-8eff-44d8-bd9a-a89de925270d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.161935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd3c3-8eff-44d8-bd9a-a89de925270d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.162232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafd3c3-8eff-44d8-bd9a-a89de925270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.182841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8eafd3c3-8eff-44d8-bd9a-a89de925270d None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:36.184047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8eafd3c3-8eff-44d8-bd9a-a89de925270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.188512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.189843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.249260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1035/2082] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:36.257297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583c9-2031-4852-b4da-635b0899e261 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.258265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583c9-2031-4852-b4da-635b0899e261 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.258646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706583c9-2031-4852-b4da-635b0899e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.262073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a726c1-700a-4085-b938-dbfeacd326ea admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.272537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.273165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.273443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.273716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.275542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.285192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-706583c9-2031-4852-b4da-635b0899e261 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:36.285608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-706583c9-2031-4852-b4da-635b0899e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.299322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1036/2083] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:36.300225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706583c9-2031-4852-b4da-635b0899e261 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.310649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706583c9-2031-4852-b4da-635b0899e261 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.315427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.316135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.316302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.316637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.317325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:36.317632 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.319578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.334473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1037/2084] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:36.336878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.347219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfac7d-a550-45e6-84b8-f6c4fdd476c1 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.357431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.357431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.357431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.357770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.357872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.357872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.358043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.358148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.365763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1048/2085] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:36.441062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1038/2086] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:36.445309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.465017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c526-6832-4376-99c9-0e843560c205 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.527767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.528428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.528709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.528980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.529619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.531587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.640025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1049/2087] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:36.644520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.654951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31250874-b0a2-4467-a5d3-6ac8b2d37b80 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.659517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.660106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.660382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.660657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.661312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.665489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.679107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1039/2088] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:36.684701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.693978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f10-b399-4f45-ad61-ed657ba5bd6a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.701485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.702233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.702666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.703024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.703775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.705852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d0a69-3934-4d06-8b08-45630038a132 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.719344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1050/2089] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:36.723829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:36.734155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d1d7-9aba-423f-b583-ec53bdb5cfc6 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:36.738726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:36.739366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.739636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.739903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] PATH_INFO: `/v3/projects/88a2f6fa687742e38e2dd4f8cc5ce4f6/users/074e091bcf344a64a344a680af7a6eb6/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.754672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a2f6fa687742e38e2dd4f8cc5ce4f6, user_id=074e091bcf344a64a344a680af7a6eb6, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:36.757287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:36.794080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:36.879612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1040/2090] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:36 2022] PUT /identity/v3/projects/88a2f6fa687742e38e2dd4f8cc5ce4f6/users/074e091bcf344a64a344a680af7a6eb6/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:36.890497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:36.890786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:36.891063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:36.920393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] MFA Rules not processed for user `074e091bcf344a64a344a680af7a6eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:36.925706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:36.995402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1051/2091] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:36.996065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.007095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:37.070124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f417-4e98-495f-a31d-3911e9e3ad91 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.075889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.076882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.077049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.077329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.077997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.079933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.204083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1041/2092] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:36 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:37.206887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.218427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982d45a-e290-4444-a5b4-2d4efed5af6e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.288384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.289046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.289330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.289627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.290278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.292186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.423207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1052/2093] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:37 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:48:37.427554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.441110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ea26-1f13-4fed-90d9-ef846adc7abc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.445945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.446588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.446865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.447136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.447772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.449355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.461015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1042/2094] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:37.476787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.492394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77295881-498a-405f-b944-c0b6b14c483e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.495410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.496094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.496483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.496765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] PATH_INFO: `/v3/projects/8a4b39d2193c445e95717c0b4cca5212/users/5a71ef9aac18404197affd3743186fb1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.518461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b39d2193c445e95717c0b4cca5212, user_id=5a71ef9aac18404197affd3743186fb1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.521381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.571121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:37.616628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1053/2095] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:37 2022] PUT /identity/v3/projects/8a4b39d2193c445e95717c0b4cca5212/users/5a71ef9aac18404197affd3743186fb1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:37.621135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.631770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852666ec-6091-431c-b503-52d1e9913fdf admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.633450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:37.686327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.686857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.687133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.687403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.688030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.689673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08154193-24e9-40a2-8433-9380c35eb43c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.699265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1043/2096] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:37.703473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.714150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02cb8b-890b-4df1-87eb-7d672f9155a7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.719701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.720341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.720616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.720885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] PATH_INFO: `/v3/projects/8a4b39d2193c445e95717c0b4cca5212/users/5a71ef9aac18404197affd3743186fb1/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.722791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b39d2193c445e95717c0b4cca5212, user_id=5a71ef9aac18404197affd3743186fb1, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.725391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.736489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1054/2097] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:37 2022] PUT /identity/v3/projects/8a4b39d2193c445e95717c0b4cca5212/users/5a71ef9aac18404197affd3743186fb1/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:37.748799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.749081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.749352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.778945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] MFA Rules not processed for user `5a71ef9aac18404197affd3743186fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:37.780137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:37.861424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1044/2098] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:37.889671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:37.946914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a0d34-bf68-4e56-aff9-f05ba2252306 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:37.950997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:37.951606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:37.951889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:37.952166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:37.961515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:37.962991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:37.973557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1055/2099] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:38.205505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:38.205505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8fc5d-5d10-4259-bd04-466dcf8e1cfe None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:38.208846 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:38.209567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:38.213822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:38.214222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:38.256031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:38.295749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:38.297457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:38.303490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:38.310967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1045/2100] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:39.079194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:39.428283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:39.970691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:40.011025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:40.319209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:41.039552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:41.108899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:42.304141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:42.306154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.374456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf297201-c3be-4c0a-a345-d880aa87797c service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:42.379619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:42.380464 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:42.383165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:42.383533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] PATH_INFO: `/v3/users/3996b0e9c0aa4d6080d8b2a08fedd6b9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:42.384805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3996b0e9c0aa4d6080d8b2a08fedd6b9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:42.387022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:42.437387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:42.438952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.453789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1b8e2-8c72-4450-9736-552203923298 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:42.459172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:42.460130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:42.460733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:42.461280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] PATH_INFO: `/v3/users/cc1c398336234105b9ed8ab256b7c7af` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:42.462610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1c398336234105b9ed8ab256b7c7af)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:42.464690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:42.655777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3996b0e9c0aa4d6080d8b2a08fedd6b9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.657287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1c398336234105b9ed8ab256b7c7af'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.658201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1c398336234105b9ed8ab256b7c7af'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.678271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3996b0e9c0aa4d6080d8b2a08fedd6b9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.680594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1c398336234105b9ed8ab256b7c7af'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.745001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3996b0e9c0aa4d6080d8b2a08fedd6b9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.745723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3996b0e9c0aa4d6080d8b2a08fedd6b9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.747563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4b7a75ab-5be4-46c2-9a4f-d83dc6cc7b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3996b0e9c0aa4d6080d8b2a08fedd6b9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.772694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1056/2101] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:42 2022] DELETE /identity/v3/users/3996b0e9c0aa4d6080d8b2a08fedd6b9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:42.774445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:42.774818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:42.775164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:42.800278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:42.801598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.816641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1c398336234105b9ed8ab256b7c7af'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.819765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6ba618f3-220e-4128-9218-05411b1d4121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1c398336234105b9ed8ab256b7c7af'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:42.837575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1046/2102] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:42 2022] DELETE /identity/v3/users/cc1c398336234105b9ed8ab256b7c7af => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:42.839450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:42.839763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:42.840036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:42.863380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:42.864661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.873682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:42.890546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1057/2103] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:42.911186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:42.912908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:42.964739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1047/2104] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:42.981968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:42.984398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:43.006203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fee56-c311-41e5-bbbb-613626f500f5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:43.080448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11525eb7-c1e8-40e9-9d19-7a8b5f4223c5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:43.095504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:43.095504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:43.095504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:43.095504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:43.096112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:43.096112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:43.096112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:43.096112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:43.096698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:43.096931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:43.103565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:43.104969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ece2e-b28e-49b9-b7c6-71203f63f6f4 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:43.112959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1058/2105] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:43.118989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1048/2106] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:43.202124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:43.203581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:43.216854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229830b-84d6-433c-8410-c24b08a77879 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:43.223926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:43.223926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:43.223926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:43.223926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] PATH_INFO: `/v3/users/e40c88c8f43346d8bc4d1169efe7dd74` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:43.224295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40c88c8f43346d8bc4d1169efe7dd74)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:43.226346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:43.614491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40c88c8f43346d8bc4d1169efe7dd74'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:43.636704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40c88c8f43346d8bc4d1169efe7dd74'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:43.758983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40c88c8f43346d8bc4d1169efe7dd74'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:43.759952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40c88c8f43346d8bc4d1169efe7dd74'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:43.761119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40c88c8f43346d8bc4d1169efe7dd74'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:43.775498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1059/2107] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:43 2022] DELETE /identity/v3/users/e40c88c8f43346d8bc4d1169efe7dd74 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:43.781002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:43.781485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:43.781577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:43.801257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:43.802471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:43.807409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:43.825635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:43.828253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:43.894782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1049/2108] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:43.895937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:43.898100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:43.906574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:44.024268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690ca-8560-4db6-a4fc-a3c8a4eff98c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.024487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80dba-4846-4c35-b2d9-68fa1ab2f2bd None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.032988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.033699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.033977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.034276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] PATH_INFO: `/v3/projects/548eafb01e38493da73af70ed61c7759` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.035544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548eafb01e38493da73af70ed61c7759)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.037574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.040092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.042782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.042782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.042782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] PATH_INFO: `/v3/projects/f520f22617fa411a8ef60bde586775a3` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.042782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f520f22617fa411a8ef60bde586775a3)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.046032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.166906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548eafb01e38493da73af70ed61c7759', 'request_id': 'req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.190625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f520f22617fa411a8ef60bde586775a3', 'request_id': 'req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.200968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f520f22617fa411a8ef60bde586775a3', 'request_id': 'req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.279422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548eafb01e38493da73af70ed61c7759', 'request_id': 'req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.287231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548eafb01e38493da73af70ed61c7759', 'request_id': 'req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.300078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] The token cache is being invalidate because project 548eafb01e38493da73af70ed61c7759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:44.300365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.301017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.302542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1060/2109] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:43 2022] DELETE /identity/v3/projects/548eafb01e38493da73af70ed61c7759 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:44.306856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.306856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.330296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f520f22617fa411a8ef60bde586775a3', 'request_id': 'req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.342784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] The token cache is being invalidate because project f520f22617fa411a8ef60bde586775a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:44.343076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.343755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.345500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1050/2110] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:43 2022] DELETE /identity/v3/projects/f520f22617fa411a8ef60bde586775a3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:44.346036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.347397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.376247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2d4f-907c-45e0-b3cf-b3e0a63bbae5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.424143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae651e-48f0-4dc9-a50f-5f76c6ae6239 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.429389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.430234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.430520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.430791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] PATH_INFO: `/v3/users/074e091bcf344a64a344a680af7a6eb6` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.432624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074e091bcf344a64a344a680af7a6eb6)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.435163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.453106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.453956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.454313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.454592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.456554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.469119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.470605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85c47a-6947-4831-ac9c-dad15c731f73 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.480747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1061/2111] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:44.482146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.482456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.482794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.505220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:44.513004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.515091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1062/2112] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:44.518446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.519489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.531992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7794d0-5174-4979-a94a-724522c2b7d2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.538082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.538872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.542296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.542296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] PATH_INFO: `/v3/users/6ee350f470184f2e9c41dcf395bf706c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.542296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee350f470184f2e9c41dcf395bf706c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.542564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.545469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:44.639691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:44.647992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074e091bcf344a64a344a680af7a6eb6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.648645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074e091bcf344a64a344a680af7a6eb6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.660303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074e091bcf344a64a344a680af7a6eb6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.770931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074e091bcf344a64a344a680af7a6eb6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.771557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-e9096c55-1847-4c24-b640-d8b6c86044d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074e091bcf344a64a344a680af7a6eb6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.784196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1051/2113] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:44 2022] DELETE /identity/v3/users/074e091bcf344a64a344a680af7a6eb6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:44.794369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415593c-f7c3-4167-afec-152c5f5a1e52 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.795249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415593c-f7c3-4167-afec-152c5f5a1e52 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.795604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415593c-f7c3-4167-afec-152c5f5a1e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.811443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee350f470184f2e9c41dcf395bf706c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.816679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b415593c-f7c3-4167-afec-152c5f5a1e52 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:44.817933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b415593c-f7c3-4167-afec-152c5f5a1e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.824311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee350f470184f2e9c41dcf395bf706c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.877551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1052/2114] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:44.879829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.880113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.880376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.898891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:44.899984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.907726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1053/2115] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:44.910920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.918019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f197dd-e38e-4a0d-b71b-cbaefbaf9d57 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:44.923443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:44.924031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:44.924309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:44.924581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:44.925219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:44.925520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:44.927158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:44.930716 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee350f470184f2e9c41dcf395bf706c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.931367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee350f470184f2e9c41dcf395bf706c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.932012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee350f470184f2e9c41dcf395bf706c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:44.944082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1054/2116] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:44.944082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.944082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:44.946737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1063/2117] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:44 2022] DELETE /identity/v3/users/6ee350f470184f2e9c41dcf395bf706c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:44.947553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:44.948895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.017587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6730fe7-9dd1-4f3d-a112-6c12284a39b9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.023151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d22c9-23b3-4481-9fb4-e8c759de0f3d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.029615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.030266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.030547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.030828 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.034685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.034685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.089667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.090368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.090667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.090932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.093216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.107464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.109303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.118985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1055/2118] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:45.119849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.121169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.133101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a5c7-b140-4e89-ba9c-42416f7fc597 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.138045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.138702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.138996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.139241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] PATH_INFO: `/v3/projects/cbd24f26eaa54d0a8d1e2f6d5908dfda` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.140357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd24f26eaa54d0a8d1e2f6d5908dfda)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.142285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.144485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1064/2119] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:44 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:45.148874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.236307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb26d-ab73-4e4a-9e32-e13b44fbac03 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.242077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.243241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.243241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.243791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.244414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.246576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.267160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:45.291217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd24f26eaa54d0a8d1e2f6d5908dfda', 'request_id': 'req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.298381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd24f26eaa54d0a8d1e2f6d5908dfda', 'request_id': 'req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.303173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:45.368469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1065/2120] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:45 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:45.375242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.385505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaeb16-026a-4a69-97c2-e90961af903f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.393693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd24f26eaa54d0a8d1e2f6d5908dfda', 'request_id': 'req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.411011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] The token cache is being invalidate because project cbd24f26eaa54d0a8d1e2f6d5908dfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:45.411639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.413608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9b14b80f-ce0c-446d-9389-6e1f4044cf9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.420411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1056/2121] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:45 2022] DELETE /identity/v3/projects/cbd24f26eaa54d0a8d1e2f6d5908dfda => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:45.423063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.423505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.423780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.448489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:45.450085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.469064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.469761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.469943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.470454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.471254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.473486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.488878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1066/2122] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:45.490070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.492773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.520400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da84d0-67a8-4474-b12a-274382a3e5c1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.526961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.527600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.528421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.528718 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] PATH_INFO: `/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.538301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3921d7dc8149818f33f5f751a1b1a4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.546764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1057/2123] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:45.546960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.547056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.547961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.564853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b1ec-531d-4718-a774-08f572229620 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.572323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.573003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.573345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.573681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.574400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.576666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e753c3a-e4cc-4f11-8390-bd167a51cf47 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.587217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1058/2124] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:45.588489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4218-6ee7-44f7-826c-bd75d3432b0e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.588777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4218-6ee7-44f7-826c-bd75d3432b0e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.589099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c4218-6ee7-44f7-826c-bd75d3432b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.611190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a75c4218-6ee7-44f7-826c-bd75d3432b0e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:45.612384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a75c4218-6ee7-44f7-826c-bd75d3432b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.620799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1059/2125] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:45.622145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.622468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.622738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.646952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:45.652727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.690685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3921d7dc8149818f33f5f751a1b1a4', 'request_id': 'req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.705516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1060/2126] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:45.706361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.719192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a5c57-5ac3-420a-98d8-8e4452a7b457 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.777046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.777696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.778530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.778816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] PATH_INFO: `/v3/projects/38abd707fb2e4e5fbcb45a8f30ad504a/users/104a084f04184bb7bb8ec55d6cf849c7/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.792478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38abd707fb2e4e5fbcb45a8f30ad504a, user_id=104a084f04184bb7bb8ec55d6cf849c7, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.795182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.855822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3921d7dc8149818f33f5f751a1b1a4', 'request_id': 'req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.863312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3921d7dc8149818f33f5f751a1b1a4', 'request_id': 'req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.873727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] The token cache is being invalidate because project 8a3921d7dc8149818f33f5f751a1b1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:45.874018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.874764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:45.876268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1067/2127] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:45 2022] DELETE /identity/v3/projects/8a3921d7dc8149818f33f5f751a1b1a4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:45.877028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.878418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:45.891738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e8c5-402a-4a38-8dff-ef5d74c7fad5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:45.896479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:45.897092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:45.897364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:45.897630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] PATH_INFO: `/v3/projects/88a2f6fa687742e38e2dd4f8cc5ce4f6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:45.898847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a2f6fa687742e38e2dd4f8cc5ce4f6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:45.900852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:45.936393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1061/2128] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:45 2022] PUT /identity/v3/projects/38abd707fb2e4e5fbcb45a8f30ad504a/users/104a084f04184bb7bb8ec55d6cf849c7/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:45.937373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:45.938997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.000657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7d7d-b232-4094-95d3-6ca8cc7da5eb admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.005197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.005792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.006067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.006474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.007113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:46.007409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.009018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.020631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1062/2129] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:46.021484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.023129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.035037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a2f6fa687742e38e2dd4f8cc5ce4f6', 'request_id': 'req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.090442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2c55-7c66-4e57-a17b-120e531d4e11 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.135802 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a2f6fa687742e38e2dd4f8cc5ce4f6', 'request_id': 'req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.143160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a2f6fa687742e38e2dd4f8cc5ce4f6', 'request_id': 'req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.148007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.148612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.148874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.149140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.151023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.153735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] The token cache is being invalidate because project 88a2f6fa687742e38e2dd4f8cc5ce4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:46.154021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.154695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e6f51b0c-86af-44ae-a7b0-0efb1a7b1b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.156196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1068/2130] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:45 2022] DELETE /identity/v3/projects/88a2f6fa687742e38e2dd4f8cc5ce4f6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:46.157549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.158073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.159887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:46.160393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.180162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:46.185323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.212665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.214444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434024d2-c23b-4d04-a379-6a3f60432e12 service swift] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.223021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1063/2131] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:48:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:46.224026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.224320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.224615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.234948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:46.242212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1069/2132] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:46.242640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.243916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.257496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219a183-096e-4e61-a2d5-3cfffb4e24b8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.263993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] MFA Rules not processed for user `104a084f04184bb7bb8ec55d6cf849c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:46.265237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.265394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.266158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.266613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.267158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.269570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.272241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6632a-9048-462c-8c39-d5402590a7fa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.333682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1064/2133] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:46.334553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.335832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.349098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44311fb7-2742-4bf4-8788-8585892f1a2a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.354694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.355419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.355635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.355903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] PATH_INFO: `/v3/users/5a71ef9aac18404197affd3743186fb1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.357689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a71ef9aac18404197affd3743186fb1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.362465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.362581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1070/2134] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:46.362581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.362888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.363165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.391557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:46.393152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.458540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1071/2135] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:46.459515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.460852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.520722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaca819-c509-4bbd-88cf-0029a7fbd3a8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.527087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.527701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.527976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.528632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.588499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.590097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.600324 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1072/2136] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:46.601225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.613138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93188e7d-e44f-4d53-8f99-dee897686afb service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.615207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a71ef9aac18404197affd3743186fb1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.615864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a71ef9aac18404197affd3743186fb1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.618144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.618847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.619304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.619663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.620378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.623125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.628342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a71ef9aac18404197affd3743186fb1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.719494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:46.759694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a71ef9aac18404197affd3743186fb1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.760696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a71ef9aac18404197affd3743186fb1'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:46.766865 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1073/2137] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:46.768670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.770486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.780038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1065/2138] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:46 2022] DELETE /identity/v3/users/5a71ef9aac18404197affd3743186fb1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:46.780797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.785640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:46.792838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56454493-96ff-4287-94c7-355159a29dd6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.858282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:46.875788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.876424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.876712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.885079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.885079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:46.885079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.885079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.901558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9fe67-e06a-4d88-839b-56e05b164086 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.910448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.910448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.910448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.910448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.910752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.912087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.913359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1074/2139] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:46.917263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.923445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1066/2140] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:46.927486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.928638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6851b2-a38a-4d4e-a7c6-a95cfb5d2715 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.934093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.934575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.934856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.935133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.935758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.937646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.938837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294c75-799a-4677-aefb-087820a0c5e9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.944657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.945420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.945926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.946355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.947329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.949054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:46.962215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1067/2141] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:46.964020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:46.974471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b98e3c-2ad0-4dec-93f6-0fd3198db95a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:46.979732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:46.980432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:46.980641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:46.980958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] PATH_INFO: `/v3/projects/96dec145d86c43de9d0d37147cf44ba9/users/e5fbab5a3b8145ecb79b68840f10e0dd/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:46.997127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dec145d86c43de9d0d37147cf44ba9, user_id=e5fbab5a3b8145ecb79b68840f10e0dd, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:46.999955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c12eb-9465-4fd0-91d9-3f87cd5a6773 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.098260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1075/2142] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:46 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:47.102804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.183098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fc549-6512-486d-8061-a3c1892a7ed5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.188245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.188786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.189063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.189330 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.189950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.192325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.211440 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1068/2143] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:46 2022] PUT /identity/v3/projects/96dec145d86c43de9d0d37147cf44ba9/users/e5fbab5a3b8145ecb79b68840f10e0dd/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:47.222410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdacc81-b81e-4434-b3bb-6de68df77413 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.222697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdacc81-b81e-4434-b3bb-6de68df77413 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.222969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdacc81-b81e-4434-b3bb-6de68df77413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.251425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-cbdacc81-b81e-4434-b3bb-6de68df77413 None None] MFA Rules not processed for user `e5fbab5a3b8145ecb79b68840f10e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:47.252770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cbdacc81-b81e-4434-b3bb-6de68df77413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.321842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1069/2144] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:47.323099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.323381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.323652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.342982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:47.344164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.354152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1076/2145] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:47.355232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.365496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df68e-ee5b-4be5-acb9-1830dc9ca3b2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.400118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1070/2146] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:47.401129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.431906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.432656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.433033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.433667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.435098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.437271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.474285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756a53c-8a58-4faa-ac1d-89f943ced2ca None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.479276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.479885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.480168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.480441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.481104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.482734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.492485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1071/2147] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:47.493432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.495228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.509697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543aa68-eff5-4b5b-802a-c2ed3536c13c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.515790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.516569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.519336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.519336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] PATH_INFO: `/v3/projects/8a4b39d2193c445e95717c0b4cca5212` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.519336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b39d2193c445e95717c0b4cca5212)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.520227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.544334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:47.553937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1077/2148] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:47.553937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.555736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.624483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9f50-a6ba-4edb-9968-ce9b8eca7bc4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.629588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.630204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.630487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.630757 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.672962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b39d2193c445e95717c0b4cca5212', 'request_id': 'req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:47.680542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b39d2193c445e95717c0b4cca5212', 'request_id': 'req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:47.690482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.692085 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.701237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1078/2149] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:48:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:47.702250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.766412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3bde-2b6c-49d0-a6d2-b48dbf83e299 service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.770450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b39d2193c445e95717c0b4cca5212', 'request_id': 'req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:47.781644 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] The token cache is being invalidate because project 8a4b39d2193c445e95717c0b4cca5212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:47.782477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:47.782582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:47.784074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1072/2150] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:47 2022] DELETE /identity/v3/projects/8a4b39d2193c445e95717c0b4cca5212 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:47.785596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.786928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.826959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.827576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.827856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.828130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.828775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.830458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898649e-a1f2-4c5f-afd2-0da7eb2f1aeb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.850619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1079/2151] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:47.852521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.853227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.853782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.874680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:47.875882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.883963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1080/2152] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:47.884693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:47.885923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:47.942447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:47.961538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f9d-01e9-4c9b-999c-3f93dde0a0b9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.963128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99e5a6-f8b4-4119-87e4-9229623bb9a9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:47.967360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.968038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.968313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.968593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.969179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:47.969319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.969848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:47.970126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:47.970439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] PATH_INFO: `/v3/projects/f7dc84a34ac249a19a07d976baae4389/users/979a32d13d774328bbd01ffe87dde989/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:47.972178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc75336-2bba-4632-a20f-24c330b14f05 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:47.988923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dc84a34ac249a19a07d976baae4389, user_id=979a32d13d774328bbd01ffe87dde989, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:47.989672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.108793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1073/2153] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:47 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:48.109968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7905bb-f7d2-44bb-b127-1eeed551a55b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.110275 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7905bb-f7d2-44bb-b127-1eeed551a55b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.110548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7905bb-f7d2-44bb-b127-1eeed551a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.125437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1081/2154] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:47 2022] PUT /identity/v3/projects/f7dc84a34ac249a19a07d976baae4389/users/979a32d13d774328bbd01ffe87dde989/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:48.125437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.139344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ab7905bb-f7d2-44bb-b127-1eeed551a55b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:48.140774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ab7905bb-f7d2-44bb-b127-1eeed551a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:48.184833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413c7e-a2ca-412d-8e92-55e3bdcc68bb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.189858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.190499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.190788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.191062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.191701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.193310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.201270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1074/2155] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:48.202653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.202943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.205851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.205981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1082/2156] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:48.205981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.216024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf606d20-e884-4d0d-ad1a-d6a485ae8a9f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.223491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.224196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.224544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.224869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.225938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:48.225938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.229334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.234548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] MFA Rules not processed for user `979a32d13d774328bbd01ffe87dde989`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:48.235810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:48.242382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1083/2157] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:48:48.243240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.253775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423511f-14ea-47e5-a1ca-132e1dfb0370 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.258742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.259517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.265998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.265998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.265998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.265998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.279422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1084/2158] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:48.280254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.291419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52603-929c-4a35-b991-f260b33fd683 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.296346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.296941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.297216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.297483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.298094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.300049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.315692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1075/2159] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:48.316520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.327041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cc98c-e584-4ea9-9f5b-3904f0c2ec49 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.331863 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.332496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.332771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.333040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] PATH_INFO: `/v3/projects/40f5ee2ab385452b9c958bbeeddc5884/users/550c2aff290d4e4e85ffee0c924b21f8/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.348553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f5ee2ab385452b9c958bbeeddc5884, user_id=550c2aff290d4e4e85ffee0c924b21f8, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.351283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.425438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1085/2160] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:48.425438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.439852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1076/2161] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:48 2022] PUT /identity/v3/projects/40f5ee2ab385452b9c958bbeeddc5884/users/550c2aff290d4e4e85ffee0c924b21f8/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:48.440745 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.501418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431a654-19fe-403a-9537-3b6f40affed4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.504963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc01e-bb39-4218-8174-88766adb31c5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.506163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.506839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.507119 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.507396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.508016 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.509929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532db91a-2f23-443b-bcbd-559b80e6e902 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.510058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.510684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.510979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.511360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.511971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.514500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab910cd-84c6-4bf3-9dda-61a55b6e118e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.608932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1077/2162] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:48.609128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1086/2163] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:48.609965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.609965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.610174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.610293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.610394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.610394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.628708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:48.629957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:48.648372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] MFA Rules not processed for user `550c2aff290d4e4e85ffee0c924b21f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:48.649690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:48.694073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:48.696851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1087/2164] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:48.697734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.726232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1078/2165] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:48.727853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.780603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e4a26-d037-449c-8f40-dea16cd8bd5f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.785328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.786219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.786339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.786534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.787167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.788871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.802377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1088/2166] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:48.804665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.806901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:48.814198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831654-6d03-47ad-ac3c-b10edfc0cbcb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.818862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.819461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.819739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.820008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.820821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.822620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.879635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687e8d-7839-46d5-817b-845892c6e661 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.884900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.885517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.886562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.886562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.895291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.896881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:48.905562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1089/2167] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:48.906358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:48.908003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:48.917783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70819517-7856-4bd3-babd-7f12c6c3f59b service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:48.926452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:48.926452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:48.926452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:48.926452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:48.926976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:48.926976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.002410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1079/2168] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:49.002410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.010207 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2823b-4668-448f-8dc1-93e382ad4740 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.015469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.016099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.016375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.016638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.017260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.018882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.029492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1080/2169] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:49.030352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.040505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17a70-fec9-469c-992e-93c14a1fcbb7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.044962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.045678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.046018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.046325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.046943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.048557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.060053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1081/2170] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:49.060937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.073570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafefc99-4d36-41f6-92fc-79b1a0d88f0f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.080803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.081567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.081796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.082144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] PATH_INFO: `/v3/projects/0b6c2d90e49e4d9285a3fd14b7d60509/users/6cf0ac91d63249d2aa1e9cc49635a99e/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.097797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c2d90e49e4d9285a3fd14b7d60509, user_id=6cf0ac91d63249d2aa1e9cc49635a99e, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.099163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1090/2171] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:48 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:49.100114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.101328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.167303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4f33b-1860-4408-805d-1b549d30990a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.172065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.172714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.172988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.173276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] PATH_INFO: `/v3/projects/5152b9ad835c49bfb4b30e92029a86b1/users/75909331b02d4832aed48ad9c05f4cfe/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.193145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152b9ad835c49bfb4b30e92029a86b1, user_id=75909331b02d4832aed48ad9c05f4cfe, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.193145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51dddf-25b5-4823-92be-2b698ace1c3e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.302029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1082/2172] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:49 2022] PUT /identity/v3/projects/0b6c2d90e49e4d9285a3fd14b7d60509/users/6cf0ac91d63249d2aa1e9cc49635a99e/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:49.302570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.336046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1091/2173] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:49 2022] PUT /identity/v3/projects/5152b9ad835c49bfb4b30e92029a86b1/users/75909331b02d4832aed48ad9c05f4cfe/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:49.337459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.337860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.338217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.365986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] MFA Rules not processed for user `6cf0ac91d63249d2aa1e9cc49635a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:49.367436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:49.368617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4daa-3b06-48ab-9515-7692733fffca admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.427927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.428787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.429328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.430036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.430888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.433165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.438354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1092/2174] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:49.439470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.456127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5098b4-6ff8-4545-b353-a3eb07613336 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.456610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.457295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.457651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.457933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.459019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.460193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.474300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1093/2175] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:49.474300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.484306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cd9f7-85d5-49a5-a4f2-ffc1e766d1d1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.489429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.490035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.490423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.490689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.491310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.493182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ef11-6310-43f8-bb44-53d59ac7cc0c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.564499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1083/2176] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:49.565428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.576776 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7723f-12a1-4852-86b6-876dc51db2a8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.581482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.582260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.582539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.582811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] PATH_INFO: `/v3/projects/5152b9ad835c49bfb4b30e92029a86b1/users/75909331b02d4832aed48ad9c05f4cfe/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.584693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152b9ad835c49bfb4b30e92029a86b1, user_id=75909331b02d4832aed48ad9c05f4cfe, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.587407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.598562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1084/2177] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:49 2022] PUT /identity/v3/projects/5152b9ad835c49bfb4b30e92029a86b1/users/75909331b02d4832aed48ad9c05f4cfe/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:49.599527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.611692 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1094/2178] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:49.612863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.613139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.613413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.651567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] MFA Rules not processed for user `75909331b02d4832aed48ad9c05f4cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:49.653482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:49.683682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a92a17-4b63-4c74-8342-e4374f881871 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.743739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1095/2179] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:49.744804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.748458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:49.756493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.757108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.757391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.758375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.758375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.759964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dd716-2adc-4446-931b-90274da38c01 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.772809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1085/2180] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:49.772809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.772809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.772809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.794384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:49.795614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:49.819717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aaa5e-37b7-4485-a301-472431551963 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.824704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.825225 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.825508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.825761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.826415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.828386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.855191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1086/2181] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:49.856699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.858061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:49.913992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaffddc-3c03-423b-bfde-cf39bead2bf8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.917869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.919102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.919369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.919639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.928638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.930052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.939526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1087/2182] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:49.940355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:49.951218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc213e-f932-4839-a206-4b5d4142dfee service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:49.954922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:49.955560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:49.955836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:49.956106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] PATH_INFO: `/v3/projects/592652d2ec8a420faba1b6ae742b1811/users/b21c45fa13a843e994e4aa2ba1e09ced/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:49.971309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592652d2ec8a420faba1b6ae742b1811, user_id=b21c45fa13a843e994e4aa2ba1e09ced, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:49.974173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:49.977437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1096/2183] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:49 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:49.978760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.054561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3f87-6a7b-41d5-b435-7554895385b8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.059338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.059950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.060269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.060501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.069208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.070819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.079351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1097/2184] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:48:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:48:50.083255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.098545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f9284-e0e5-4583-ae8a-1d410f3a6270 service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.104581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.105290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.105897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.108229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.109650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.111382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.116034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1088/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:49 2022] PUT /identity/v3/projects/592652d2ec8a420faba1b6ae742b1811/users/b21c45fa13a843e994e4aa2ba1e09ced/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:50.117271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.118886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:50.129412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1098/2186] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:50.131304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.144844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42165956-b932-484d-87fe-6951b7db00e6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.181883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176011d5-0741-4180-89b8-381e67058269 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.185351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.185949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.186257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.190343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.210467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.210989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.211262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.211551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.212429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.214223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.226501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1099/2187] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:50.227099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.240693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fc0a3-e356-448a-a183-9dc1867e3f83 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.245651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.246374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.246695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.246956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] PATH_INFO: `/v3/projects/a31045c0504144f3b65ab5873d55cd94/users/b8bfdf7ee6ec49d2962126c5965a815d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.275477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31045c0504144f3b65ab5873d55cd94, user_id=b8bfdf7ee6ec49d2962126c5965a815d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.278935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.280351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.280643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.291201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1089/2188] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:50.291484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.302105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611426d7-2317-4324-b830-c719d290a044 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.309095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.309751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.310025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.310340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] PATH_INFO: `/v3/projects/592652d2ec8a420faba1b6ae742b1811/users/b21c45fa13a843e994e4aa2ba1e09ced/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.312535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592652d2ec8a420faba1b6ae742b1811, user_id=b21c45fa13a843e994e4aa2ba1e09ced, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.315212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1723-a7d6-490d-b702-54e9faaeb530 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.330223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1090/2189] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:50 2022] PUT /identity/v3/projects/592652d2ec8a420faba1b6ae742b1811/users/b21c45fa13a843e994e4aa2ba1e09ced/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:50.336607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.336891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.337157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.371575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] MFA Rules not processed for user `b21c45fa13a843e994e4aa2ba1e09ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:50.372909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:50.444486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:50.447162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1100/2190] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:50 2022] PUT /identity/v3/projects/a31045c0504144f3b65ab5873d55cd94/users/b8bfdf7ee6ec49d2962126c5965a815d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:50.451879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.467015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1091/2191] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:50.522661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15159c-9019-4982-82e9-6d705021bba5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.527841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.528463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.528741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.529256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.529911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.531541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787a684-d0f9-4f2c-8f5b-903931ee3b97 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.541955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1101/2192] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:50.558774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.608551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a390b-7bb8-48e1-8ad6-de4d80a81914 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.613104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.613744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.614019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.614329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] PATH_INFO: `/v3/projects/a31045c0504144f3b65ab5873d55cd94/users/b8bfdf7ee6ec49d2962126c5965a815d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.616765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31045c0504144f3b65ab5873d55cd94, user_id=b8bfdf7ee6ec49d2962126c5965a815d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:50.619469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:50.629435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1092/2193] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:50 2022] PUT /identity/v3/projects/a31045c0504144f3b65ab5873d55cd94/users/b8bfdf7ee6ec49d2962126c5965a815d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:50.640724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.641015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.641289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.660850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:50.675405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] MFA Rules not processed for user `b8bfdf7ee6ec49d2962126c5965a815d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:50.675814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:50.749316 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1102/2194] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:50.927460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:50.983310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570d1d-bd04-4bed-8113-315aeb369000 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:50.986841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:50.987439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:50.987738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:50.988009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:50.989710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:51.046604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:51.053660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:51.057179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1093/2195] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:51.160936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:51.170616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6d26-ecd5-4d04-87d1-9752aa93947f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:51.174339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:51.174951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:51.175232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:51.175505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:51.185278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:51.186799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:51.196542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1103/2196] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:51.501984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:51.685327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:52.296476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:52.502017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:53.239900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:53.329349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.419232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d8e85-8448-4b3e-97f5-8d6cdbe70c0c service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.423938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.424708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.424986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.425256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] PATH_INFO: `/v3/users/6cf0ac91d63249d2aa1e9cc49635a99e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.426575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf0ac91d63249d2aa1e9cc49635a99e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.428604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.544461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:53.644189 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf0ac91d63249d2aa1e9cc49635a99e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.644867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf0ac91d63249d2aa1e9cc49635a99e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.660499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf0ac91d63249d2aa1e9cc49635a99e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.753760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.759111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf0ac91d63249d2aa1e9cc49635a99e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.759941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b3e34e79-43f8-47fb-833a-f5aa366552d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf0ac91d63249d2aa1e9cc49635a99e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:53.764047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7957afa-b30b-4f18-86b0-92e9e706d680 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:53.776651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1094/2197] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:53 2022] DELETE /identity/v3/users/6cf0ac91d63249d2aa1e9cc49635a99e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:53.781733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.782021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.782343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.784506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:53.785296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:53.785488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:53.785746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:53.787498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.803823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:53.804810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:53.880789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:53.882977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:53.898675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1104/2198] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:48:53.903971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1095/2199] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:53.916300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:53.917913 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.002470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d7eb-08a7-4583-a543-a4c62d1ec5b9 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.062069 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.063164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.063598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.064021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.074345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.077826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.089408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1105/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:54.679303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:54.725864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:54.727326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:54.739893 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124ae11-3333-4787-9a60-6ce5bd09cb94 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:54.744880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:54.745794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:54.746098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:54.746425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] PATH_INFO: `/v3/projects/0b6c2d90e49e4d9285a3fd14b7d60509` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:54.747551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6c2d90e49e4d9285a3fd14b7d60509)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:54.749530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:54.983606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6c2d90e49e4d9285a3fd14b7d60509', 'request_id': 'req-11e1d2ec-6b14-4091-a7cf-d5ed29916024'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:54.990174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6c2d90e49e4d9285a3fd14b7d60509', 'request_id': 'req-11e1d2ec-6b14-4091-a7cf-d5ed29916024'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.153095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6c2d90e49e4d9285a3fd14b7d60509', 'request_id': 'req-11e1d2ec-6b14-4091-a7cf-d5ed29916024'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.163738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] The token cache is being invalidate because project 0b6c2d90e49e4d9285a3fd14b7d60509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:55.165042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.165042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.166054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1096/2201] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:54 2022] DELETE /identity/v3/projects/0b6c2d90e49e4d9285a3fd14b7d60509 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:55.170844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:55.180898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee42e7-e520-4044-a0c9-99ccb7990c01 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:55.188907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:55.253224 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:55.254272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:55.254387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:55.254873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] PATH_INFO: `/v3/users/b8bfdf7ee6ec49d2962126c5965a815d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:55.255879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bfdf7ee6ec49d2962126c5965a815d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:55.258496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:55.594898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bfdf7ee6ec49d2962126c5965a815d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.608690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bfdf7ee6ec49d2962126c5965a815d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.724416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bfdf7ee6ec49d2962126c5965a815d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.725089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bfdf7ee6ec49d2962126c5965a815d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.725723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bfdf7ee6ec49d2962126c5965a815d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:55.739339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1106/2202] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:55 2022] DELETE /identity/v3/users/b8bfdf7ee6ec49d2962126c5965a815d => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:56.439876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:56.442347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:56.457546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1d2ec-6b14-4091-a7cf-d5ed29916024 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:56.504271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:56.506314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:56.586688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:56.587340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:56.587618 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:56.587895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] PATH_INFO: `/v3/projects/a31045c0504144f3b65ab5873d55cd94` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:56.589045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31045c0504144f3b65ab5873d55cd94)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:56.591028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:56.592154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f7a30-0b1c-475d-91c8-4ec47b02c674 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:56.597739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:56.598758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:56.599034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:56.599310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] PATH_INFO: `/v3/users/ed492b61eb0e44c8b5ab7caf5cd2507c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:56.600453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed492b61eb0e44c8b5ab7caf5cd2507c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:56.602404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:56.897012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:56.899970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:56.912739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed492b61eb0e44c8b5ab7caf5cd2507c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:56.913172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31045c0504144f3b65ab5873d55cd94', 'request_id': 'req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:56.922400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31045c0504144f3b65ab5873d55cd94', 'request_id': 'req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:56.930019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed492b61eb0e44c8b5ab7caf5cd2507c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.061756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31045c0504144f3b65ab5873d55cd94', 'request_id': 'req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.073086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] The token cache is being invalidate because project a31045c0504144f3b65ab5873d55cd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:57.073506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.074231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.075809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1097/2203] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:56 2022] DELETE /identity/v3/projects/a31045c0504144f3b65ab5873d55cd94 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:57.076769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.078027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.133772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4aea0-91a4-4ed0-bd69-ce8ae878845d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.137408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.138011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.138317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.138589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.140408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.182443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed492b61eb0e44c8b5ab7caf5cd2507c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.183078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed492b61eb0e44c8b5ab7caf5cd2507c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.183724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-66281b51-9db4-45f8-b149-7b69fb40bd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed492b61eb0e44c8b5ab7caf5cd2507c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.197350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1107/2204] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:56 2022] DELETE /identity/v3/users/ed492b61eb0e44c8b5ab7caf5cd2507c => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:57.198905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada519-3641-4228-a590-74558ad6669f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.199287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada519-3641-4228-a590-74558ad6669f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.199591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aada519-3641-4228-a590-74558ad6669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.208537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.209979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b521-6e86-4396-9864-74bf3284d053 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.220798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1098/2205] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:57.221672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6aada519-3641-4228-a590-74558ad6669f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:57.222742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.223174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.223291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6aada519-3641-4228-a590-74558ad6669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.228761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.244624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:57.246066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.312633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1108/2206] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:57.319877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.320403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.320778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.329794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1099/2207] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:57.344293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.344637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:57.346137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.346320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.355799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1109/2208] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:57.359952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.372001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a8608-6815-4250-aa10-4407dfaacf42 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.374912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.375518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.375791 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.376057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.376697 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:48:57.376993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.378626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.391355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1110/2209] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:48:57.395795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.408411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d5032-5882-4616-a40a-1a8020da4e2a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.415076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.416231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.416617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.417309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.418072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.420185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.431308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888535-e719-4a45-8db1-1f8a62790e00 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.438354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.439246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.439869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.440469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.454333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.455957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.468570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1100/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:57.473044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.474991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.489534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27b9d-d3c4-46e0-b631-eb7e49d85076 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.497314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.498036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.498399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.498868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] PATH_INFO: `/v3/users/979a32d13d774328bbd01ffe87dde989` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.506485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979a32d13d774328bbd01ffe87dde989)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.506485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.544207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1111/2211] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:57.545641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.648246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e707947-b2b4-4e81-a79e-c79fe81dd0b6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.659781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.660436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.661134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.661134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.661767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.663758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.819205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1112/2212] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:57 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:57.823748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.839341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979a32d13d774328bbd01ffe87dde989'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.840152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979a32d13d774328bbd01ffe87dde989'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.853756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201d5-9df7-4b9a-b3b9-c3b7fb048f09 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.860492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979a32d13d774328bbd01ffe87dde989'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.863616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.864819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.864819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.865017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.867686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.870723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.884677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1113/2213] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:57.892963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.896519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.938451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866e83-495d-413b-a835-7a381453f08d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.943701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.944325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.944664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.944940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.945708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.947534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.958986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1114/2214] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:57.963412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:57.967733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:57.978898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638aa3-c2aa-4e90-b9d5-e5576b2bec5b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:57.984484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:57.985240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:57.985513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:57.985704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] PATH_INFO: `/v3/projects/8669fceab64144828ca5aab86b8f39b6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:57.986852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8669fceab64144828ca5aab86b8f39b6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:57.988750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:57.992950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979a32d13d774328bbd01ffe87dde989'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:57.993753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979a32d13d774328bbd01ffe87dde989'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.020393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1101/2215] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:57 2022] DELETE /identity/v3/users/979a32d13d774328bbd01ffe87dde989 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:58.021205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.094462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831db498-b7a6-49f5-8bfd-88784b9dfcb8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.099894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.100890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.101247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.101578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] PATH_INFO: `/v3/projects/ecbf83f734ff4396ba5dbd570fc0c4eb/users/3c8a5a526fa1453d97a84cf52bfeb324/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.118612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbf83f734ff4396ba5dbd570fc0c4eb, user_id=3c8a5a526fa1453d97a84cf52bfeb324, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.121332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb55d2-bc19-434a-9458-1f3364aad390 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.270788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1102/2216] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:58 2022] PUT /identity/v3/projects/ecbf83f734ff4396ba5dbd570fc0c4eb/users/3c8a5a526fa1453d97a84cf52bfeb324/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:58.270788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305688-b96a-4a87-b45c-5c67ffdcd1d1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.270788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305688-b96a-4a87-b45c-5c67ffdcd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.270788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71305688-b96a-4a87-b45c-5c67ffdcd1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.297014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-71305688-b96a-4a87-b45c-5c67ffdcd1d1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:58.297014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-71305688-b96a-4a87-b45c-5c67ffdcd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.301397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8669fceab64144828ca5aab86b8f39b6', 'request_id': 'req-d7875664-473a-489e-aeca-6d9f4e786525'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.360350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1103/2217] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:58.361589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.361871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.362141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.374837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8669fceab64144828ca5aab86b8f39b6', 'request_id': 'req-d7875664-473a-489e-aeca-6d9f4e786525'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.382063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8669fceab64144828ca5aab86b8f39b6', 'request_id': 'req-d7875664-473a-489e-aeca-6d9f4e786525'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.391769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] MFA Rules not processed for user `3c8a5a526fa1453d97a84cf52bfeb324`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:58.393131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.398020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] The token cache is being invalidate because project 8669fceab64144828ca5aab86b8f39b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:58.398445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.399096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:58.400739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1115/2218] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:57 2022] DELETE /identity/v3/projects/8669fceab64144828ca5aab86b8f39b6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:58.407550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.413538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.502361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1104/2219] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:48:58.507276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.515522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.532465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7875664-473a-489e-aeca-6d9f4e786525 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.534109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c405cb1-95f5-45b1-8c01-9a9a999968d8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.537323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.537969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.538598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.538885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.541958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:58.542216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.542998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.543609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.544064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.544895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.548074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.555058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:58.575922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.577388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:58.588856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1116/2220] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:58.731842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1105/2221] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:58.741571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:58.751415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b68-a99f-4606-ada3-6041ef615481 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:58.808217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:58.808822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:58.809094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:58.809363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:58.809976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:58.811921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.027467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1117/2222] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:48:58 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:48:59.031657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.042210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74de077-8dc5-4264-9d81-354db148bec5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.047286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.047887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.048163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.048434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.049096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.050716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.062553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1106/2223] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:48:59.065985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.076635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19ccd-9d9b-466d-b33c-c3e8058c6be6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.081428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.082092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.082406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.085926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] PATH_INFO: `/v3/projects/4dd43a489e4840769df31ea16a9ca56a/users/4e7fd8b1124741a58f63122d14936d3e/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.097473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd43a489e4840769df31ea16a9ca56a, user_id=4e7fd8b1124741a58f63122d14936d3e, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.100137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.131665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.133751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:59.148869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bd7a9-75bd-4a7c-bb21-64c71d2f00ee admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.154535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.155245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.155528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.155800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] PATH_INFO: `/v3/projects/f7dc84a34ac249a19a07d976baae4389` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.157009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dc84a34ac249a19a07d976baae4389)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.159034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.200600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1118/2224] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:59 2022] PUT /identity/v3/projects/4dd43a489e4840769df31ea16a9ca56a/users/4e7fd8b1124741a58f63122d14936d3e/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:48:59.200600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.260217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24681cdf-e4e0-4c50-8a14-b4852d33a065 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.265794 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.266421 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.266695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.266965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.267599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.269222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.279849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1119/2225] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:48:59.288591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.298167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f702ad-a6c4-4d79-a231-f99eaee301a7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.302903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dc84a34ac249a19a07d976baae4389', 'request_id': 'req-d96ddfac-33b1-4e03-b408-65e65270defd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.309638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dc84a34ac249a19a07d976baae4389', 'request_id': 'req-d96ddfac-33b1-4e03-b408-65e65270defd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.320917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:48:59.360454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.361446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.361722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.361993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] PATH_INFO: `/v3/projects/4dd43a489e4840769df31ea16a9ca56a/users/4e7fd8b1124741a58f63122d14936d3e/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.364357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd43a489e4840769df31ea16a9ca56a, user_id=4e7fd8b1124741a58f63122d14936d3e, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.368092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0e92-44d8-43cf-a937-8944c9e468e0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.379819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1120/2226] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:48:59 2022] PUT /identity/v3/projects/4dd43a489e4840769df31ea16a9ca56a/users/4e7fd8b1124741a58f63122d14936d3e/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:59.390810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.391096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.391393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.415766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dc84a34ac249a19a07d976baae4389', 'request_id': 'req-d96ddfac-33b1-4e03-b408-65e65270defd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.422445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] MFA Rules not processed for user `4e7fd8b1124741a58f63122d14936d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:48:59.423811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:59.427174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] The token cache is being invalidate because project f7dc84a34ac249a19a07d976baae4389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:48:59.427464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.428197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.429825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1107/2227] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:48:59 2022] DELETE /identity/v3/projects/f7dc84a34ac249a19a07d976baae4389 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:48:59.434148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.435554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:59.451006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ddfac-33b1-4e03-b408-65e65270defd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.498089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1121/2228] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:48:59.508586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:48:59.509961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:48:59.518216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.518857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.519134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.519456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] PATH_INFO: `/v3/users/75909331b02d4832aed48ad9c05f4cfe` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.520596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=75909331b02d4832aed48ad9c05f4cfe)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.522663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.567813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea5cee-b5ad-4044-92c2-f9c99887066f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:48:59.572000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:48:59.572133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:48:59.572378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:48:59.572649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:48:59.582080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:48:59.583536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:48:59.592786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1122/2229] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:48:59.794310 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75909331b02d4832aed48ad9c05f4cfe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.795576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75909331b02d4832aed48ad9c05f4cfe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.808405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75909331b02d4832aed48ad9c05f4cfe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.883961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75909331b02d4832aed48ad9c05f4cfe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.884602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75909331b02d4832aed48ad9c05f4cfe'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:48:59.898353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1108/2230] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:48:59 2022] DELETE /identity/v3/users/75909331b02d4832aed48ad9c05f4cfe => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:00.179184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.180629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.195952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86575e-f1c2-4fe4-8123-07840f8003d1 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.268176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.268987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.269394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.269770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] PATH_INFO: `/v3/users/3c8a5a526fa1453d97a84cf52bfeb324` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.271366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8a5a526fa1453d97a84cf52bfeb324)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.274173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.371757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.374163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.390365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434967f-5841-4b61-8614-fca86ef085ac admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.404993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.405958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.406721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.407160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] PATH_INFO: `/v3/projects/5152b9ad835c49bfb4b30e92029a86b1` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.408591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5152b9ad835c49bfb4b30e92029a86b1)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.410585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.480303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8a5a526fa1453d97a84cf52bfeb324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.492498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8a5a526fa1453d97a84cf52bfeb324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.537282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5152b9ad835c49bfb4b30e92029a86b1', 'request_id': 'req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.544171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5152b9ad835c49bfb4b30e92029a86b1', 'request_id': 'req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.604394 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8a5a526fa1453d97a84cf52bfeb324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.605013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8a5a526fa1453d97a84cf52bfeb324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.605703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bf3bda13-e00f-4b43-9f0c-da331c4356a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8a5a526fa1453d97a84cf52bfeb324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.620428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1123/2231] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:00 2022] DELETE /identity/v3/users/3c8a5a526fa1453d97a84cf52bfeb324 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:00.624751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34730e65-bc07-4b15-9730-baae09726718 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.624974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34730e65-bc07-4b15-9730-baae09726718 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.625246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34730e65-bc07-4b15-9730-baae09726718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.644021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-34730e65-bc07-4b15-9730-baae09726718 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:00.645210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34730e65-bc07-4b15-9730-baae09726718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.661251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5152b9ad835c49bfb4b30e92029a86b1', 'request_id': 'req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.672782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] The token cache is being invalidate because project 5152b9ad835c49bfb4b30e92029a86b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:00.673067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.673728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8a7a8fdc-36dc-4437-91d7-5ddaf381d061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:00.675238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1109/2232] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:00 2022] DELETE /identity/v3/projects/5152b9ad835c49bfb4b30e92029a86b1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:00.680595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.680890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.681217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.700826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:00.702042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.706023 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1124/2233] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:00.719148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1110/2234] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:00.725607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.725891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.726162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.727499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.729115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.746846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:00.748173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:00.756380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1125/2235] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:00.760916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.769970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b35af-4153-43aa-a4cd-82ec57284335 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.774601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.775177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.775446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.775713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.776469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:00.776657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.778252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.786002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2654f-5029-4e03-87d2-411c3b3c64b7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.789736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.790378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.790661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.790867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1126/2236] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:00.790983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.795565 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.802452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.803976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.805214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6ad73-25bb-4087-9f3e-c33cb23c2963 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:00.813080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:00.813671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:00.813948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:00.814395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:00.815155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:00.818968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1111/2237] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:00.825679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:00.873419 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:00.955381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1127/2238] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:00.960329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:00.971764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb940af-a258-40eb-be81-52b0ebf829bd service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.027526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.028130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.028408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.028677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.029286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.031227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.154076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1112/2239] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:00 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:01.158299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.168893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70a1a-dc26-43da-8736-8981298c8cd1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.173689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.179854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.179854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.179854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.179854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.179854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.187357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1128/2240] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:01.191363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.201500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4891b-4eee-4063-bde1-35bdbf4333db admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.206283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.206875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.207153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.207651 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.208386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.209949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.220411 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1113/2241] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:01.222257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:01.224487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.235144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b28ef-54b9-4e79-a593-db31b57da4b4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.240780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.241563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.241902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.242165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] PATH_INFO: `/v3/projects/f4125f8928f34743b6e13241aa58bc4e/users/82a577a292d54ac8ad85dc084823a494/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.245769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.248009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.258921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4125f8928f34743b6e13241aa58bc4e, user_id=82a577a292d54ac8ad85dc084823a494, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.266466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee60d1-d70c-4abf-969b-bb2eff63a9a4 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.266657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c813be-75f7-4b74-998d-c09aedad15e8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.271084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.271864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.272141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.272533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] PATH_INFO: `/v3/projects/ecbf83f734ff4396ba5dbd570fc0c4eb` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.273697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbf83f734ff4396ba5dbd570fc0c4eb)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.275832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.336065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1129/2242] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:01 2022] PUT /identity/v3/projects/f4125f8928f34743b6e13241aa58bc4e/users/82a577a292d54ac8ad85dc084823a494/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:01.346956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.347244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.347520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.374932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] MFA Rules not processed for user `82a577a292d54ac8ad85dc084823a494`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:01.376144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.435923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbf83f734ff4396ba5dbd570fc0c4eb', 'request_id': 'req-50c6189f-6594-475c-8f4a-99a488f51fcb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.443036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbf83f734ff4396ba5dbd570fc0c4eb', 'request_id': 'req-50c6189f-6594-475c-8f4a-99a488f51fcb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.444055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1130/2243] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:01.458410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.461092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.513323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbf83f734ff4396ba5dbd570fc0c4eb', 'request_id': 'req-50c6189f-6594-475c-8f4a-99a488f51fcb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.528491 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] The token cache is being invalidate because project ecbf83f734ff4396ba5dbd570fc0c4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:01.529247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.530002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.534680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1114/2244] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:01 2022] DELETE /identity/v3/projects/ecbf83f734ff4396ba5dbd570fc0c4eb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:01.535834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.537233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.537344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618213a9-fdc8-4ac7-8b6b-60fa962b47b5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.590631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.591236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.591518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.591785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.593537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.610966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6189f-6594-475c-8f4a-99a488f51fcb admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.615617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.616239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.616510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.616778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] PATH_INFO: `/v3/users/4e7fd8b1124741a58f63122d14936d3e` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.617891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7fd8b1124741a58f63122d14936d3e)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.619879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.653410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.654945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.663810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1131/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:01.685711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:01.687748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:01.701082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b89ec-be6d-433e-81d1-d8334c6ee516 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:01.705743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:01.706390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:01.706669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:01.706941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] PATH_INFO: `/v3/users/82a577a292d54ac8ad85dc084823a494` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:01.708079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a577a292d54ac8ad85dc084823a494)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:01.709988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:01.811896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7fd8b1124741a58f63122d14936d3e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.812666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7fd8b1124741a58f63122d14936d3e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.825070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7fd8b1124741a58f63122d14936d3e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.930296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7fd8b1124741a58f63122d14936d3e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.930827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-44341112-6af0-4b9e-9073-021423031092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7fd8b1124741a58f63122d14936d3e'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:01.943833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1115/2246] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:01 2022] DELETE /identity/v3/users/4e7fd8b1124741a58f63122d14936d3e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:01.991666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a577a292d54ac8ad85dc084823a494'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.005008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a577a292d54ac8ad85dc084823a494'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.106728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a577a292d54ac8ad85dc084823a494'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.107405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a577a292d54ac8ad85dc084823a494'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.108046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a577a292d54ac8ad85dc084823a494'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.120999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1132/2247] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:01 2022] DELETE /identity/v3/users/82a577a292d54ac8ad85dc084823a494 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:02.126096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.126540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.126879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.146829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:02.148308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.150115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:02.233476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1116/2248] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:02.243902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.245305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.319520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d7db8-ce13-4898-928b-3e3838d7e6e7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.323783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.325131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.325410 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.325722 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.335469 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.337078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a210ee-2492-4411-a439-dc1eb6ebcf32 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.348206 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1133/2249] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:02.407903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.407903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.416270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d6e9-ea1e-43df-af6e-43e45c0c4fe7 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.422005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.422814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.423241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.423720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] PATH_INFO: `/v3/projects/4dd43a489e4840769df31ea16a9ca56a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.424962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd43a489e4840769df31ea16a9ca56a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.427148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.611827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd43a489e4840769df31ea16a9ca56a', 'request_id': 'req-9679ad47-97b7-43fa-8833-84f0e9be5108'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.623130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd43a489e4840769df31ea16a9ca56a', 'request_id': 'req-9679ad47-97b7-43fa-8833-84f0e9be5108'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.657286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:02.741358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd43a489e4840769df31ea16a9ca56a', 'request_id': 'req-9679ad47-97b7-43fa-8833-84f0e9be5108'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.759617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] The token cache is being invalidate because project 4dd43a489e4840769df31ea16a9ca56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:02.760336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.763603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-9679ad47-97b7-43fa-8833-84f0e9be5108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:02.765150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1117/2250] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:02 2022] DELETE /identity/v3/projects/4dd43a489e4840769df31ea16a9ca56a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:02.771339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.771665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.771940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.797690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:02.798931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.886230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1134/2251] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:02.890534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.890819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.891089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.932763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:02.934228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:02.942431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1118/2252] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:02.946931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:02.957182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd950-2a4f-42f5-bc47-9745db4c0e54 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:02.961844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:02.962475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:02.962755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:02.963024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:02.963663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:02.963964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:02.966139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:02.979575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1135/2253] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:02.990854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.001284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2f95-0107-4b5a-a823-3d93d35157ad None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.013028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.015389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.017052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.018029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.018339 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.018735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.019572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.023557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.052213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f7a8b-ea62-45d5-b2b8-3cf84fd4a782 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.071402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.072374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.073641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.074633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] PATH_INFO: `/v3/projects/f4125f8928f34743b6e13241aa58bc4e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.076242 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4125f8928f34743b6e13241aa58bc4e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.078282 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.174120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1119/2254] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:02 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:03.179811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.218135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4125f8928f34743b6e13241aa58bc4e', 'request_id': 'req-3ee32580-250e-43cf-a936-f2651fba4464'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:03.282398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5947c08-912c-401c-9edd-11cd6a9d10ff admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.311740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4125f8928f34743b6e13241aa58bc4e', 'request_id': 'req-3ee32580-250e-43cf-a936-f2651fba4464'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:03.324958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4125f8928f34743b6e13241aa58bc4e', 'request_id': 'req-3ee32580-250e-43cf-a936-f2651fba4464'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:03.338454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] The token cache is being invalidate because project f4125f8928f34743b6e13241aa58bc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:03.338753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:03.342823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ee32580-250e-43cf-a936-f2651fba4464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:03.344374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1136/2255] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:03 2022] DELETE /identity/v3/projects/f4125f8928f34743b6e13241aa58bc4e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:03.349467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23991-b31b-460c-b155-ef10174a3560 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.349770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23991-b31b-460c-b155-ef10174a3560 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.358105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a23991-b31b-460c-b155-ef10174a3560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.368465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.374351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.374351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.374351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.374351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.374351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.397188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-09a23991-b31b-460c-b155-ef10174a3560 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:03.400442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-09a23991-b31b-460c-b155-ef10174a3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.412866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1137/2256] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:03.422295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.422583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.422858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.452166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:03.453428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.465651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1138/2257] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:03.466977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.476804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380233f-5d3f-4d29-b73c-8a63c93dc639 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.482376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.482996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.483263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.483532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.484180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:03.484479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.486588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.502693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1139/2258] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:03.506275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.519349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95e7d-f599-4c34-a8a5-21fea0c27f14 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.530614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1120/2259] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/users => generated 286 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:03.534926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.536541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.538504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.540041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.540328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.540700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.543588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.546595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.556674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945296d-a55b-49fb-bdd0-ee2fb89c26f7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.565116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.565736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.566133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.566437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.567106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.570991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.579282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1121/2260] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:03.583242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.592876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecfb9a-9797-43f9-a38e-6474d6cce55a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.597509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.601538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.601538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.601538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.601538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.601538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.612191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1122/2261] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:03.616336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.626540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff0643-abbe-4915-b1de-ca06011b0fad admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.631238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.631847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.636201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.636201 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] PATH_INFO: `/v3/projects/8349f3940c034e22b3c3eea969cdd5ce/users/71c190ab07a54d7a9d12123cc99be55b/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.646839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8349f3940c034e22b3c3eea969cdd5ce, user_id=71c190ab07a54d7a9d12123cc99be55b, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.649769 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae681a6-b006-4627-ae84-d37e10a80719 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.693247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1140/2262] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:03.697359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:03.753393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1123/2263] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:03 2022] PUT /identity/v3/projects/8349f3940c034e22b3c3eea969cdd5ce/users/71c190ab07a54d7a9d12123cc99be55b/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:03.763144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5aa3f-a31c-4afb-8077-f7e69478aafb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:03.764792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.765251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.765524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.795085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] MFA Rules not processed for user `71c190ab07a54d7a9d12123cc99be55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:03.796693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:03.829531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:03.830250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:03.830613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:03.831528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:03.841921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:03.841921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:03.884693 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1124/2264] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:04.009493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.011135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.027864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1141/2265] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:03 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:04.032037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.045984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4dfd1-ee4c-469e-b489-e9122fe3adda admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.065537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.066157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.066462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.066733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.067559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.069165 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.083992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1142/2266] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:04.085748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.097489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518b799-b5ea-4430-997c-0d7b0f1f4437 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.101889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac04da8-1ae8-4538-8aa2-d4fab420f32b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.104556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.105529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.105880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.106270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.107050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.107568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.108441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.108849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.109163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.109508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.119228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.120804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.135147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1125/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:04.135684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1143/2268] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:04.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.155242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890c97f-6d3b-4258-beb9-9dee34e07091 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.160891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.161742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.162232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.162813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] PATH_INFO: `/v3/projects/cf049ed589774002aacc77a47753aaa7/users/60fee33b6ccb4c63bf2c9492dce22b32/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.168379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.181934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27f34-52b4-4332-aef3-2610946ecde3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.193423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf049ed589774002aacc77a47753aaa7, user_id=60fee33b6ccb4c63bf2c9492dce22b32, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.196782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3fb6c-cbf6-42f4-b4bf-d44578eca1f0 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.202525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.203476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.203763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.204041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] PATH_INFO: `/v3/users/71c190ab07a54d7a9d12123cc99be55b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.205288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c190ab07a54d7a9d12123cc99be55b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.207307 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.336544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1126/2269] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:04 2022] PUT /identity/v3/projects/cf049ed589774002aacc77a47753aaa7/users/60fee33b6ccb4c63bf2c9492dce22b32/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:04.348104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.348580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.348854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.388383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] MFA Rules not processed for user `60fee33b6ccb4c63bf2c9492dce22b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:04.391569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.460344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:04.467243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c190ab07a54d7a9d12123cc99be55b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.497452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c190ab07a54d7a9d12123cc99be55b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.509734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1127/2270] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:04.510640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.512828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.583626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537c928-da8d-4f80-b7f5-e70b1e75abab None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.588202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.588831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.589108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.589378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] PATH_INFO: `/v3/users/e5fbab5a3b8145ecb79b68840f10e0dd` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.591460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fbab5a3b8145ecb79b68840f10e0dd)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.593402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.627170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c190ab07a54d7a9d12123cc99be55b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.627935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c190ab07a54d7a9d12123cc99be55b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.628760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c190ab07a54d7a9d12123cc99be55b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.642365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1144/2271] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:04 2022] DELETE /identity/v3/users/71c190ab07a54d7a9d12123cc99be55b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:04.645229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.645229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.706465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dfacb-b27d-40e9-b642-4fd8acf1f436 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.710066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.710724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.711004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.711273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.713036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.773395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.774876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305cec6-03f1-44fe-8cb5-f16c34b91df3 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.784221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1145/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:04.785587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.785713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.785963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.806904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:04.808139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.839343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fbab5a3b8145ecb79b68840f10e0dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.841248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fbab5a3b8145ecb79b68840f10e0dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.855272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fbab5a3b8145ecb79b68840f10e0dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.865924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:04.878669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1146/2273] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:04.888705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:04.890140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:04.947818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d16429-c5dd-4d78-b851-e221a59bbbf2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:04.952104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:04.952709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.952982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.953250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:04.962265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:04.963668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eb223-5662-45cb-b9c4-c0227d2990ea service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:04.973136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1147/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:04.975409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fbab5a3b8145ecb79b68840f10e0dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.976057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fbab5a3b8145ecb79b68840f10e0dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:04.989203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1128/2275] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:04 2022] DELETE /identity/v3/users/e5fbab5a3b8145ecb79b68840f10e0dd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:04.993624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:04.993902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:04.994277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:05.019216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:05.020427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:05.081656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1148/2276] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:05.101642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:05.145493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a388b-db67-4a5f-b036-3b46e30beaea admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:05.149135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:05.149762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:05.150040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:05.150346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:05.159636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:05.161053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:05.170962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1129/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:06.138024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.142348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.154152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c1b5f-7f0f-4079-b285-3f66660b6438 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.159182 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.160336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.160792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.161081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] PATH_INFO: `/v3/projects/8349f3940c034e22b3c3eea969cdd5ce` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.162320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8349f3940c034e22b3c3eea969cdd5ce)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.164713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.173762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.175773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.200116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b539-807a-4313-b8ad-6fc5bf463607 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.209405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.210851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.211323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.212700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] PATH_INFO: `/v3/projects/96dec145d86c43de9d0d37147cf44ba9` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.214286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dec145d86c43de9d0d37147cf44ba9)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.222569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.362720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8349f3940c034e22b3c3eea969cdd5ce', 'request_id': 'req-f4aef191-8828-416c-9d55-0260acfb5524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.364851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dec145d86c43de9d0d37147cf44ba9', 'request_id': 'req-c759a2a4-bcde-4654-b50e-077d5cb66112'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.372074 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dec145d86c43de9d0d37147cf44ba9', 'request_id': 'req-c759a2a4-bcde-4654-b50e-077d5cb66112'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.472684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8349f3940c034e22b3c3eea969cdd5ce', 'request_id': 'req-f4aef191-8828-416c-9d55-0260acfb5524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.480139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8349f3940c034e22b3c3eea969cdd5ce', 'request_id': 'req-f4aef191-8828-416c-9d55-0260acfb5524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.491366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] The token cache is being invalidate because project 8349f3940c034e22b3c3eea969cdd5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:06.491699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.492319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4aef191-8828-416c-9d55-0260acfb5524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.493840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1149/2278] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:06 2022] DELETE /identity/v3/projects/8349f3940c034e22b3c3eea969cdd5ce => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:06.498582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00c6f-02f1-4481-81ed-c9a18cbd89e8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.498945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00c6f-02f1-4481-81ed-c9a18cbd89e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.499222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d00c6f-02f1-4481-81ed-c9a18cbd89e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.524005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a5d00c6f-02f1-4481-81ed-c9a18cbd89e8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:06.534236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a5d00c6f-02f1-4481-81ed-c9a18cbd89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.599433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1150/2279] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:06.601314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.601605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.601884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.615567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dec145d86c43de9d0d37147cf44ba9', 'request_id': 'req-c759a2a4-bcde-4654-b50e-077d5cb66112'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.621720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:06.628395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.628723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] The token cache is being invalidate because project 96dec145d86c43de9d0d37147cf44ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:06.628977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.629607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.631849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1130/2280] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:06 2022] DELETE /identity/v3/projects/96dec145d86c43de9d0d37147cf44ba9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:06.631947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1151/2281] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:06.635308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.635877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.637080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.646283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffe396-fb75-482b-a7d0-afbf0d3a13fd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.650741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759a2a4-bcde-4654-b50e-077d5cb66112 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.653576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.654661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.655402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.670917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.671015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.671134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:06.671134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.671316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.671316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.671316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] PATH_INFO: `/v3/users/550c2aff290d4e4e85ffee0c924b21f8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.671316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=550c2aff290d4e4e85ffee0c924b21f8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.671316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.672305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.694297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1152/2282] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:06.695080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.696882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:06.710634 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffbdae-d435-4828-8abd-75a3745e8923 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.715989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.716598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.716877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.717145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.717766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.719698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:06.852102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1153/2283] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:06 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:06.857096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:06.880456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550c2aff290d4e4e85ffee0c924b21f8'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.881111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550c2aff290d4e4e85ffee0c924b21f8'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.906235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550c2aff290d4e4e85ffee0c924b21f8'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:06.927354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92226d15-d8ab-4719-a990-05a03c1b1238 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:06.928810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:06.929420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:06.929705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:06.930017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:06.930707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:06.932630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.032680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550c2aff290d4e4e85ffee0c924b21f8'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.033273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550c2aff290d4e4e85ffee0c924b21f8'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.047125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1131/2284] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:06 2022] DELETE /identity/v3/users/550c2aff290d4e4e85ffee0c924b21f8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:07.069639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1154/2285] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:06 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:07.077522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.079125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:07.152803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17782266-f2c9-4659-937d-bc5c929e88cb admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.160946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.160946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.160946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.160946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.161306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.162301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.173357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1132/2286] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:07.177838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.188389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660c877-fe57-4f2c-a50d-af09ce4a0b45 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.195272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.195272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.195272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.195272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.195688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.196354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1d37e-7aa3-40d0-8096-92754d1f060f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.206390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1155/2287] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:07.210808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.224110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ffb8-a0fd-4463-a033-70971ec9cdc5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.226622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.227355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.227701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.228521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] PATH_INFO: `/v3/projects/4cad8e3eb2cf4eabb22c6ebc348530ea/users/6a7eca18b7c949e9a1527d0a7b71ed8a/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.244938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cad8e3eb2cf4eabb22c6ebc348530ea, user_id=6a7eca18b7c949e9a1527d0a7b71ed8a, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.248646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.373647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1133/2288] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:07 2022] PUT /identity/v3/projects/4cad8e3eb2cf4eabb22c6ebc348530ea/users/6a7eca18b7c949e9a1527d0a7b71ed8a/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:07.384026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.384318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.384599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.420418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] MFA Rules not processed for user `6a7eca18b7c949e9a1527d0a7b71ed8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:07.421687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:07.488332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1156/2289] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:07.500340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.502172 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:07.508545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.518462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:07.586472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bc11b-2b46-46a2-8c0d-c345df699d15 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.586992 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bf3bf-e223-42a1-8c4f-e4b05893bc93 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:07.590344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.591064 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.591422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.591765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.591944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:07.592574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:07.592852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:07.593362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] PATH_INFO: `/v3/projects/40f5ee2ab385452b9c958bbeeddc5884` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:07.594518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f5ee2ab385452b9c958bbeeddc5884)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.596425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.601194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:07.602730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:07.613048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1134/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:07.789034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f5ee2ab385452b9c958bbeeddc5884', 'request_id': 'req-4301358f-e3ef-4981-9641-a714c42dbbd2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.890910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:07.919540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f5ee2ab385452b9c958bbeeddc5884', 'request_id': 'req-4301358f-e3ef-4981-9641-a714c42dbbd2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.936045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f5ee2ab385452b9c958bbeeddc5884', 'request_id': 'req-4301358f-e3ef-4981-9641-a714c42dbbd2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.955723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] The token cache is being invalidate because project 40f5ee2ab385452b9c958bbeeddc5884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:07.956107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.957672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4301358f-e3ef-4981-9641-a714c42dbbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:07.959691 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1157/2291] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:07 2022] DELETE /identity/v3/projects/40f5ee2ab385452b9c958bbeeddc5884 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:07.968039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:07.978966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8537e3-e01c-4ec0-a507-28c6c5113beb service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:08.071643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:08.072399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:08.072987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:08.073366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] PATH_INFO: `/v3/users/b21c45fa13a843e994e4aa2ba1e09ced` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:08.075469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21c45fa13a843e994e4aa2ba1e09ced)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:08.080087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:08.368011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:08.469831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21c45fa13a843e994e4aa2ba1e09ced'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.470504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21c45fa13a843e994e4aa2ba1e09ced'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.483217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21c45fa13a843e994e4aa2ba1e09ced'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.604290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21c45fa13a843e994e4aa2ba1e09ced'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.604926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21c45fa13a843e994e4aa2ba1e09ced'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:08.618725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1135/2292] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:07 2022] DELETE /identity/v3/users/b21c45fa13a843e994e4aa2ba1e09ced => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:08.917188 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:08.917702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:08.917814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:08.938172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] MFA Rules not processed for user `9767d18cf0944f16b45fff4214128c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:08.939449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:08.999855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1158/2293] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:09.179041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:09.181011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:09.261212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff935cc-85e1-4eed-b637-08d74adf4ba6 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:09.267372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:09.268296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:09.268767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:09.269112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] PATH_INFO: `/v3/projects/592652d2ec8a420faba1b6ae742b1811` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:09.270408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=592652d2ec8a420faba1b6ae742b1811)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:09.272533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:09.451441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592652d2ec8a420faba1b6ae742b1811', 'request_id': 'req-270395aa-fad3-48ec-9672-d5ee774846cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.457956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592652d2ec8a420faba1b6ae742b1811', 'request_id': 'req-270395aa-fad3-48ec-9672-d5ee774846cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.552789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592652d2ec8a420faba1b6ae742b1811', 'request_id': 'req-270395aa-fad3-48ec-9672-d5ee774846cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.566198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] The token cache is being invalidate because project 592652d2ec8a420faba1b6ae742b1811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:09.566858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.568181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-270395aa-fad3-48ec-9672-d5ee774846cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:09.570006 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1136/2294] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:09 2022] DELETE /identity/v3/projects/592652d2ec8a420faba1b6ae742b1811 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:09.673093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:09.777797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:09.779294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:09.794239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161c48-51b7-468e-934e-2b457cd43252 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:09.849404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:09.850035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:09.850344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:09.850638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] PATH_INFO: `/v3/users/60fee33b6ccb4c63bf2c9492dce22b32` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:09.851747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fee33b6ccb4c63bf2c9492dce22b32)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:09.853985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:10.114139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fee33b6ccb4c63bf2c9492dce22b32'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.122826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fee33b6ccb4c63bf2c9492dce22b32'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.242907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fee33b6ccb4c63bf2c9492dce22b32'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.246778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fee33b6ccb4c63bf2c9492dce22b32'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.246778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fee33b6ccb4c63bf2c9492dce22b32'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:10.258553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1159/2295] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:09 2022] DELETE /identity/v3/users/60fee33b6ccb4c63bf2c9492dce22b32 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:10.263391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.263835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.264175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.283799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:10.285005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.345958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1137/2296] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:10.355939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.357448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.426060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca87c2-8d7d-4287-bc72-984b8da6bb06 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:10.431617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:10.437861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.437861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.437861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.443047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:10.444488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d44eb-7576-40f5-adb5-761b5c2d3d0c service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:10.454962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1160/2297] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:10.977571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:10.977571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:10.990942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf884a0-4bad-4350-a071-be9b0005c5fc None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:10.996443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:10.997175 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:10.997458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:10.997741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] PATH_INFO: `/v3/projects/cf049ed589774002aacc77a47753aaa7` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:10.999456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf049ed589774002aacc77a47753aaa7)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.000934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.112013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf049ed589774002aacc77a47753aaa7', 'request_id': 'req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:11.118236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf049ed589774002aacc77a47753aaa7', 'request_id': 'req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:11.141686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:11.192462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf049ed589774002aacc77a47753aaa7', 'request_id': 'req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:11.203259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] The token cache is being invalidate because project cf049ed589774002aacc77a47753aaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:11.203480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:11.204112 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a2168bee-6c58-4dbf-ae5e-e2bae7cdafe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:11.205624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1138/2298] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:10 2022] DELETE /identity/v3/projects/cf049ed589774002aacc77a47753aaa7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:11.211009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.211476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.211598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.232219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:11.233426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:11.296839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1161/2299] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:11.305215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.305659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.305785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.326832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:11.328021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:11.335805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1139/2300] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:11.344151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.354246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad04577-e9ca-4995-8996-7cd8635d8a92 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.360642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.364208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.364208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.364208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.364208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:11.364208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.365548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.382269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1162/2301] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:11.386714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.396163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee945e-d271-4526-ad61-968aea6c80f4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.400940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.401562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.401838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.402639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.403300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.410038 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.526166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1140/2302] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:11.531536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.543291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81432-977c-4f4d-8793-9e4b82b990f4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.601172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.601833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.602113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.602631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.603643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.606140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.690599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1163/2303] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:11.694858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.709365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdd036-d678-4e32-bdff-21775c4ff0dd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.711418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.712057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.712330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.712600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.713239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.716303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.735821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1141/2304] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:11.737166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.747661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f6a6-988f-4497-a66d-ea6eac204300 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.752952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.754961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.754961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.754961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.754961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.756857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5948-aabf-4737-807c-777f9961187b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.768518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1164/2305] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:11.772785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:11.783446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab5ea-b55d-4ca9-b208-f00e19920225 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:11.787973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:11.788621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.788899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.789177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] PATH_INFO: `/v3/projects/fb0ce066743b4e20ad19b2ca3cb292cf/users/a2204f0a421e41f8a57f550a9a173861/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:11.804155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0ce066743b4e20ad19b2ca3cb292cf, user_id=a2204f0a421e41f8a57f550a9a173861, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:11.806836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:11.958855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1142/2306] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:11 2022] PUT /identity/v3/projects/fb0ce066743b4e20ad19b2ca3cb292cf/users/a2204f0a421e41f8a57f550a9a173861/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:11.970767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:11.971264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:11.971668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.004736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] MFA Rules not processed for user `a2204f0a421e41f8a57f550a9a173861`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:12.005968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:12.076345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1165/2307] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:12.082480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.146331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8860a3b-8e23-4d37-8809-b6f711bd5119 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.151147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.151806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.152617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.152890 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.153549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.155477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.181491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:12.278994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1143/2308] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:12.283050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.293920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233290-5209-4154-90dc-a6c794de0be7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.351134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.352126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.352407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.352685 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.353708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.355907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.445510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1166/2309] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:12.450389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.461526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47314-cbb4-4ac2-8b09-3a93a9d325bc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.466190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.466871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.467145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.467422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.468044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.469640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.480393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1144/2310] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:12.484653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.495344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b3ef-b099-496d-be58-286e65b8558f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.500655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.501268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.501545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.501815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.502492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.504281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be926d-be51-4fab-9715-566fb60b07e3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.515075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1167/2311] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:12.519511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.529786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6535df-2d5a-49b3-a0b7-7e33ed3575d3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.534464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.535109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.535488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.535856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] PATH_INFO: `/v3/projects/a9012fae53fa42d4973cbd1e4d242a57/users/0d24aaaabf984615934896220d84642c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.552091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9012fae53fa42d4973cbd1e4d242a57, user_id=0d24aaaabf984615934896220d84642c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.554711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.632994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1145/2312] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:12 2022] PUT /identity/v3/projects/a9012fae53fa42d4973cbd1e4d242a57/users/0d24aaaabf984615934896220d84642c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:12.643931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.644487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.644935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.675241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] MFA Rules not processed for user `0d24aaaabf984615934896220d84642c`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:12.676539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:12.742397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1168/2313] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:12.747938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.799537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:12.817686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b0f2-85ce-4673-9152-8d9eec19aa30 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:12.822957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:12.823571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:12.824401 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:12.824673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:12.825296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:12.827243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:12.955706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1146/2314] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:12.959830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:12.970442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ccf0-f5f6-4483-9a93-1a57395074ee None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.026036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.026688 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.027066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.027267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.027893 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.029818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.149950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1169/2315] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:12 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:13.151186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.161548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51e7f-4ada-4282-97e3-553d33ac2c48 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.166163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.166789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.167070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.167342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.167978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.169560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.180127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1147/2316] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:49:13.185217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.195549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53877581-391d-4381-be91-bd4ffe7d7a57 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.200723 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.201383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.201664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.201940 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] PATH_INFO: `/v3/projects/2212981fb9e346c9b59823a3c05dc692/users/c75cb4fd1e7b4f31918780718d1e1ab8/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.216502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2212981fb9e346c9b59823a3c05dc692, user_id=c75cb4fd1e7b4f31918780718d1e1ab8, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.219232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.282000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1170/2317] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:13 2022] PUT /identity/v3/projects/2212981fb9e346c9b59823a3c05dc692/users/c75cb4fd1e7b4f31918780718d1e1ab8/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:13.286110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.298305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6370aae-0539-42b1-b192-3328973c9a18 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.358083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.358720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.358998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.359269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.359907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.361496 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd743-05c1-4ccb-8f6e-3b656e20db6c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.372044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1148/2318] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:13.376292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.388014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b39a8c-1f9c-495b-81cd-69b9bffb7abb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.393529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:13.394389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.395102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.395382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.395662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] PATH_INFO: `/v3/projects/2212981fb9e346c9b59823a3c05dc692/users/c75cb4fd1e7b4f31918780718d1e1ab8/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.397575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2212981fb9e346c9b59823a3c05dc692, user_id=c75cb4fd1e7b4f31918780718d1e1ab8, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.400284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.410557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1171/2319] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:13 2022] PUT /identity/v3/projects/2212981fb9e346c9b59823a3c05dc692/users/c75cb4fd1e7b4f31918780718d1e1ab8/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:13.422424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.422712 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.422990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.451559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] MFA Rules not processed for user `c75cb4fd1e7b4f31918780718d1e1ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:13.454451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:13.526732 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1149/2320] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:13.537945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:13.539651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:13.603404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd56b9-a739-4315-af98-b3ba175a344b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:13.604196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:13.607574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:13.608187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:13.608449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:13.608717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:13.668771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:13.670234 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:13.679144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1172/2321] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:13.804417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:14.119076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:14.421686 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:14.843949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:15.375962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:15.844763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:15.854785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9e69-b854-445f-83c0-ff6420d7e989 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:15.859316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:15.859916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:15.860191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:15.860459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:15.901394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:15.937492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:15.938356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:15.954216 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1150/2322] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:16.486320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:17.575757 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:17.744216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:17.745779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:17.904377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f62e1-3379-4732-8e68-a1e1d9e3e81c service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:17.912682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:17.915826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:17.916383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:17.917136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] PATH_INFO: `/v3/users/6a7eca18b7c949e9a1527d0a7b71ed8a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:17.920472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7eca18b7c949e9a1527d0a7b71ed8a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:17.923057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:18.017984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:18.030457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ec7a-774f-40bd-a3a7-43a6eab4c3a4 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:18.035334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:18.036208 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:18.036638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:18.037111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:18.048767 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:18.050570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d965d-b58c-4d1a-9c35-184d08a64b65 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:18.065428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1151/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:18.194781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7eca18b7c949e9a1527d0a7b71ed8a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:18.213578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7eca18b7c949e9a1527d0a7b71ed8a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:18.261740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:18.312141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7eca18b7c949e9a1527d0a7b71ed8a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:18.313305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7eca18b7c949e9a1527d0a7b71ed8a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:18.319638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7eca18b7c949e9a1527d0a7b71ed8a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:18.337062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1173/2324] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:17 2022] DELETE /identity/v3/users/6a7eca18b7c949e9a1527d0a7b71ed8a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:18.338544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fefff6-9865-4e2e-bee1-d1a194448fc0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:18.338856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fefff6-9865-4e2e-bee1-d1a194448fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:18.339672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fefff6-9865-4e2e-bee1-d1a194448fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:18.362355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-04fefff6-9865-4e2e-bee1-d1a194448fc0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:18.363999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-04fefff6-9865-4e2e-bee1-d1a194448fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:18.461460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1152/2325] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:18.466490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:18.468707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:18.535186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b0f6c-15de-4246-8a21-1355c1a2bcfa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:18.538875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:18.539489 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:18.539766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:18.540037 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:18.549939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:18.551511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:18.563643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1174/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:18.572831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:18.573101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:18.573375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:18.594082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:18.595325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:18.662354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1153/2327] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:18.675288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:18.676926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:18.752871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620da19-2ca3-4318-a69c-0ddab1c447cc service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:18.758383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:18.759005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:18.759291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:18.759587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:18.770784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:18.772759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:18.781838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1175/2328] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:49:19.282360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:19.294433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:19.346361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b7424-62ba-477b-9014-deac8f810e65 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:19.352159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:19.379996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:19.380227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:19.380432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:19.380877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] PATH_INFO: `/v3/projects/4cad8e3eb2cf4eabb22c6ebc348530ea` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:19.384288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cad8e3eb2cf4eabb22c6ebc348530ea)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:19.386630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:19.531285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cad8e3eb2cf4eabb22c6ebc348530ea', 'request_id': 'req-a0cc58fb-b082-4898-841a-1488c435d1f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:19.547305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cad8e3eb2cf4eabb22c6ebc348530ea', 'request_id': 'req-a0cc58fb-b082-4898-841a-1488c435d1f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:19.681278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cad8e3eb2cf4eabb22c6ebc348530ea', 'request_id': 'req-a0cc58fb-b082-4898-841a-1488c435d1f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:19.697645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] The token cache is being invalidate because project 4cad8e3eb2cf4eabb22c6ebc348530ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:19.700127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:19.702721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a0cc58fb-b082-4898-841a-1488c435d1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:19.708089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1154/2329] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:19 2022] DELETE /identity/v3/projects/4cad8e3eb2cf4eabb22c6ebc348530ea => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:19.859189 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:20.553087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:20.592659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:21.286005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:22.022535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:23.721596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:23.723148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:23.735629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:23.774213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5a15-55f2-4696-a4ab-6a9c8b66c059 service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:23.846068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:23.847129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:23.847592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:23.847868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] PATH_INFO: `/v3/users/a2204f0a421e41f8a57f550a9a173861` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:23.849142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2204f0a421e41f8a57f550a9a173861)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:23.851198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:23.877838 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:24.086131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2204f0a421e41f8a57f550a9a173861'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.090626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:24.116907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2204f0a421e41f8a57f550a9a173861'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.209549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2204f0a421e41f8a57f550a9a173861'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.210318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2204f0a421e41f8a57f550a9a173861'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.211024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2204f0a421e41f8a57f550a9a173861'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:24.239951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1176/2330] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:23 2022] DELETE /identity/v3/users/a2204f0a421e41f8a57f550a9a173861 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:24.248008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:24.248469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:24.249128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:24.273517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:24.275035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:24.365425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1155/2331] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:24.379817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:24.383131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:24.456317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5e5e9-6098-4bb4-b8f0-49ac40871f20 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:24.461000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:24.461731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:24.462256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:24.462552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:24.473162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:24.474704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:24.485227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1177/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:24.973165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:24.975049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:25.004104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7322-a391-4903-8a3f-efd03e530880 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:25.018249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:25.018922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:25.019213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:25.019500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] PATH_INFO: `/v3/projects/fb0ce066743b4e20ad19b2ca3cb292cf` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:25.021729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0ce066743b4e20ad19b2ca3cb292cf)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:25.023920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:25.158782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:25.162751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0ce066743b4e20ad19b2ca3cb292cf', 'request_id': 'req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.169620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0ce066743b4e20ad19b2ca3cb292cf', 'request_id': 'req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.239107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0ce066743b4e20ad19b2ca3cb292cf', 'request_id': 'req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.262708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] The token cache is being invalidate because project fb0ce066743b4e20ad19b2ca3cb292cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:25.262708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.262708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.268677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1156/2333] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:24 2022] DELETE /identity/v3/projects/fb0ce066743b4e20ad19b2ca3cb292cf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:25.270151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:25.283675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e66e-fc0d-4666-b33c-88890683926b service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:25.364539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:25.365443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:25.365726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:25.366059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] PATH_INFO: `/v3/users/0d24aaaabf984615934896220d84642c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:25.367582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d24aaaabf984615934896220d84642c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:25.369534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:25.610661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:25.616473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d24aaaabf984615934896220d84642c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.632402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d24aaaabf984615934896220d84642c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.764111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d24aaaabf984615934896220d84642c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.764840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d24aaaabf984615934896220d84642c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.765449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d24aaaabf984615934896220d84642c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:25.779919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1178/2334] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:25 2022] DELETE /identity/v3/users/0d24aaaabf984615934896220d84642c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:26.939598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:26.948857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:26.963124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b2fa1-964d-4e89-82d1-c363b2c4724a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.047549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.052003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.052003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.052003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] PATH_INFO: `/v3/projects/a9012fae53fa42d4973cbd1e4d242a57` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.052003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9012fae53fa42d4973cbd1e4d242a57)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.052915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.193184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9012fae53fa42d4973cbd1e4d242a57', 'request_id': 'req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.202758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9012fae53fa42d4973cbd1e4d242a57', 'request_id': 'req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.295331 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9012fae53fa42d4973cbd1e4d242a57', 'request_id': 'req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.325582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] The token cache is being invalidate because project a9012fae53fa42d4973cbd1e4d242a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:27.326132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.327116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.329370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1157/2335] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:26 2022] DELETE /identity/v3/projects/a9012fae53fa42d4973cbd1e4d242a57 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:27.333623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:27.335750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:27.354703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e014-d540-494c-9921-754081ef5001 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:27.465275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:27.465936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:27.466244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:27.466529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] PATH_INFO: `/v3/users/c75cb4fd1e7b4f31918780718d1e1ab8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:27.467772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75cb4fd1e7b4f31918780718d1e1ab8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:27.469972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:27.673471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75cb4fd1e7b4f31918780718d1e1ab8'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.696538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75cb4fd1e7b4f31918780718d1e1ab8'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.798014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75cb4fd1e7b4f31918780718d1e1ab8'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.799019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75cb4fd1e7b4f31918780718d1e1ab8'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.799936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-edc9672b-dd0e-4337-b3fb-1e0f1cd1801a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75cb4fd1e7b4f31918780718d1e1ab8'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:27.819482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1179/2336] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:27 2022] DELETE /identity/v3/users/c75cb4fd1e7b4f31918780718d1e1ab8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:28.404673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:28.404673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:28.427502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023e6e9-f5ef-4afc-9100-4f2cec49c6c2 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:28.746792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:28.747532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:28.747814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:28.748090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] PATH_INFO: `/v3/projects/2212981fb9e346c9b59823a3c05dc692` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:28.749375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2212981fb9e346c9b59823a3c05dc692)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:28.751459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:28.763655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:28.949960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2212981fb9e346c9b59823a3c05dc692', 'request_id': 'req-fdf6ed12-0083-4bd0-8a71-93133127e15f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:28.965071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2212981fb9e346c9b59823a3c05dc692', 'request_id': 'req-fdf6ed12-0083-4bd0-8a71-93133127e15f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:29.079677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2212981fb9e346c9b59823a3c05dc692', 'request_id': 'req-fdf6ed12-0083-4bd0-8a71-93133127e15f'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:29.098547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] The token cache is being invalidate because project 2212981fb9e346c9b59823a3c05dc692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:29.101325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:29.103426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-fdf6ed12-0083-4bd0-8a71-93133127e15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:29.126101 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1158/2337] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:28 2022] DELETE /identity/v3/projects/2212981fb9e346c9b59823a3c05dc692 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:29.127911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.129843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.129843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.202571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:29.206595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:29.275829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:29.335200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1180/2338] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:29.343860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.344453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.345289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.378492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:29.381018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:29.401771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1159/2339] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:29.406218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:29.424509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7d6d-c738-4668-95a8-c88e48c9b4c6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:29.435174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:29.436111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.436564 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.437009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.437819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:29.438317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:29.440345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:29.455627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1181/2340] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:29.460156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:29.471092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123db0-fc8a-4797-a8d3-8909f624e3a5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:29.483123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:29.488553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.488553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.488553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.488553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:29.491091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:29.632810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1160/2341] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:29 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:29.637162 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:29.649628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8293b74-5fed-4eb4-9576-76456ed30e2d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:29.728574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:29.729649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.729649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.729649 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.730673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:29.733363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:29.907518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1182/2342] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:29 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:29.908838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:29.922930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cc64f-5a18-4574-a30e-a2a5b0feea9e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:29.929202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:29.930156 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.930851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.930851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.931416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:29.934575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:29.954885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1161/2343] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:29.958933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:29.986538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848b137-fa25-458e-8831-cca242ba74af admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:29.991340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:29.991340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:29.991707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:29.991947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:29.992604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:29.994269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78922c-25ea-44bb-992a-b360380ee9fc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:30.009824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1183/2344] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:30.017286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:30.029800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a80eb-7cf6-4b4a-9bde-18ba1b8df252 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:30.035552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:30.036241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:30.036524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:30.036799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] PATH_INFO: `/v3/projects/6c80cd3f9d1846f681161b53ea5334a2/users/e9b628d987394c028cb6e7a761d5d3cd/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:30.069998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c80cd3f9d1846f681161b53ea5334a2, user_id=e9b628d987394c028cb6e7a761d5d3cd, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:30.075642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:30.374450 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1162/2345] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:30 2022] PUT /identity/v3/projects/6c80cd3f9d1846f681161b53ea5334a2/users/e9b628d987394c028cb6e7a761d5d3cd/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:30.385158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:30.385771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:30.385771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:30.426104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] MFA Rules not processed for user `e9b628d987394c028cb6e7a761d5d3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:30.427456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:30.557343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1184/2346] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:30.569316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:30.571308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:30.646234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be2cd-a76d-4859-92ce-b8056f055f0b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:30.646234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:30.646234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:30.646234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:30.646768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:30.653829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:30.655404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18223c91-4d24-408b-91ec-46c2e695e4e2 service glance] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:30.671856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1163/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:36.657915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:36.659407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:36.697670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:36.731851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af104f-f5a5-4e87-8499-6dc88bfbbccd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:36.736597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:36.737241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:36.737520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:36.737796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] PATH_INFO: `/v3/users/104a084f04184bb7bb8ec55d6cf849c7` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:36.738979 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104a084f04184bb7bb8ec55d6cf849c7)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:36.740931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:36.966966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104a084f04184bb7bb8ec55d6cf849c7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:36.979064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104a084f04184bb7bb8ec55d6cf849c7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:37.065854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104a084f04184bb7bb8ec55d6cf849c7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:37.066503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104a084f04184bb7bb8ec55d6cf849c7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:37.067110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104a084f04184bb7bb8ec55d6cf849c7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:37.080342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1185/2348] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:49:36 2022] DELETE /identity/v3/users/104a084f04184bb7bb8ec55d6cf849c7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:37.084891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:37.085425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:37.085425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:37.105212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:37.106448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:37.136567 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:37.165824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1164/2349] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:37.176415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:37.178049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:37.243412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ab97-356e-4643-9b2e-ccc17ba5d8c2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:37.247116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:37.248000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:37.248000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:37.250497 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:37.258060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:37.259607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f9bcf-3958-4477-948a-39f33bed296d service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:37.270928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1186/2350] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:37.845089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:37.846685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:37.862456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85993c5-ccc5-4da7-9800-b4229a9c676e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:37.868213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:37.868947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:37.869289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:37.870169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] PATH_INFO: `/v3/projects/38abd707fb2e4e5fbcb45a8f30ad504a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:37.871568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38abd707fb2e4e5fbcb45a8f30ad504a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:37.873538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.010096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38abd707fb2e4e5fbcb45a8f30ad504a', 'request_id': 'req-26f681e2-bc79-458f-91fa-8e91f59b314c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:38.016853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38abd707fb2e4e5fbcb45a8f30ad504a', 'request_id': 'req-26f681e2-bc79-458f-91fa-8e91f59b314c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:38.111943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38abd707fb2e4e5fbcb45a8f30ad504a', 'request_id': 'req-26f681e2-bc79-458f-91fa-8e91f59b314c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:38.126226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] The token cache is being invalidate because project 38abd707fb2e4e5fbcb45a8f30ad504a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:49:38.126524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:38.127186 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-26f681e2-bc79-458f-91fa-8e91f59b314c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:49:38.128682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1165/2351] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:49:37 2022] DELETE /identity/v3/projects/38abd707fb2e4e5fbcb45a8f30ad504a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:49:38.133653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.134148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.134291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.159539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:38.161310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:38.217840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:38.232230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1187/2352] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:38.240115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.240404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.240704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.261117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:38.262535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:38.271355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1166/2353] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:38.275553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.285556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd0ad-4ae8-4d2a-a99e-dc14301bec9f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.290577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.302571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.306560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1188/2354] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:49:38.311748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.322324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9696f3-382b-4a70-b0ab-7ade437dcebb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.328258 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.328939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.329549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.329821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.330506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.335198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.445826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1167/2355] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:49:38 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:49:38.449733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.460623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912598e-71c0-4105-9be6-563ab62ffd55 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.524508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.525186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.525498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.525775 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.527030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.529033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.643996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1189/2356] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:49:38 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:49:38.648294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.659525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f3931-6760-43c3-acde-9f684918a83f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.664327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.664933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.665209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.665482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.666118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.668288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.680319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1168/2357] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:38.687508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.698786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb4e2f-ceb5-4719-a1a3-665a009306a4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.704246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.704875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.705153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.707439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.707439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.707944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b7ce-c39c-450c-b4ce-a872db0d217a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.719906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1190/2358] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:49:38.724481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:38.735477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf54d31-4e1a-46b6-b888-b117f508662f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:38.742002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:38.742002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.742002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.742002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] PATH_INFO: `/v3/projects/0c2a708479cc40d1ae36a20c67fe85ad/users/910335d588824554b1c5191ca8270f51/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.756641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2a708479cc40d1ae36a20c67fe85ad, user_id=910335d588824554b1c5191ca8270f51, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:38.759322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:38.883461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1169/2359] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:49:38 2022] PUT /identity/v3/projects/0c2a708479cc40d1ae36a20c67fe85ad/users/910335d588824554b1c5191ca8270f51/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:49:38.895456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995539-4c93-43c9-bc5c-b0d27f19d7ae None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:38.895744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995539-4c93-43c9-bc5c-b0d27f19d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:38.896018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995539-4c93-43c9-bc5c-b0d27f19d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:38.951004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c5995539-4c93-43c9-bc5c-b0d27f19d7ae None None] MFA Rules not processed for user `910335d588824554b1c5191ca8270f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:38.951004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c5995539-4c93-43c9-bc5c-b0d27f19d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:39.001223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1191/2360] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:39.013133 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:39.014867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:39.074907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818af7d9-676a-4ea2-abb8-b456f1d7f29a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:39.078554 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:39.079161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:39.079482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:39.079681 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:39.086495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:39.089149 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:39.092878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a91eea-f196-43ee-8968-d5cb02eb8fb5 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:39.100089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1170/2361] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:49:39.680391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:39.681280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:39.681720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:39.683873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1192/2362] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:49:39.689716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8916-17cb-47bf-888c-4dbbadb2dbe9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:39.690136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8916-17cb-47bf-888c-4dbbadb2dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:39.690276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8916-17cb-47bf-888c-4dbbadb2dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:39.714771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7cac8916-17cb-47bf-888c-4dbbadb2dbe9 None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:39.716004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7cac8916-17cb-47bf-888c-4dbbadb2dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:39.784060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1171/2363] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:39.799965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:39.801911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:39.899196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711c51-bd7d-4435-8a39-1dc9ae374474 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:39.903449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:39.904586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:39.904709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:39.905018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:39.913844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:39.917675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:39.923082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9066815-6877-4d08-bfe3-a2da77cd9f65 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:39.932771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1193/2364] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:40.301882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.304193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.304193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.304193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1172/2365] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:49:40.308755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097698-e8da-4703-97e0-b1869de55803 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.309072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097698-e8da-4703-97e0-b1869de55803 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.309352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097698-e8da-4703-97e0-b1869de55803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.330154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-12097698-e8da-4703-97e0-b1869de55803 None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:40.331395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-12097698-e8da-4703-97e0-b1869de55803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:40.387553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1194/2366] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:40.399474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:40.401278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:40.414352 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c9c1a-706c-4d8d-a9f8-554e0456aa72 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:40.418304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:40.419020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.419211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.419484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.427085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:40.428510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9276e-67b8-426a-ae3f-cb0bd3caf8d2 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:40.436962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1173/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:40.524713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf336a1-f8af-4de9-af5b-cb2237ad80b5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.525009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf336a1-f8af-4de9-af5b-cb2237ad80b5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.525288 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf336a1-f8af-4de9-af5b-cb2237ad80b5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.527284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1195/2368] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:49:40.532823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf3a-64e7-4260-9693-932d1245da7e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.533103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf3a-64e7-4260-9693-932d1245da7e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.533421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bbf3a-64e7-4260-9693-932d1245da7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.561314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c71bbf3a-64e7-4260-9693-932d1245da7e None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:40.562575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c71bbf3a-64e7-4260-9693-932d1245da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:40.571605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1174/2369] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:49:40.583789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf336a1-f8af-4de9-af5b-cb2237ad80b5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:40.595561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf336a1-f8af-4de9-af5b-cb2237ad80b5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:40.599203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:40.599797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:40.600073 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:40.600345 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:40.610852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:40.612278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:40.623079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1196/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:49:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:49:50.555936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=42 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:50.618453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=32 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:49:54.758586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:54.759080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:54.759183 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:54.779523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:49:54.779870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:54.834599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1175/2371] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:49:54.857325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:49:54.859072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:49:54.933457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6b44-96ba-46a2-a372-f01c4919bea4 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:49:54.939592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:49:54.940201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:49:54.940479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:49:54.940752 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:49:54.949996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:49:54.951894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa1787-98ca-4065-b37c-62da2c4401cb service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:49:54.961889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1197/2372] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:50:04.744912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:04.817475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36192af-b842-4616-92f7-9b73477bc608 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:04.821942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:04.822600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:04.823404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:04.823691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] PATH_INFO: `/v3/users/910335d588824554b1c5191ca8270f51` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:04.824780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=910335d588824554b1c5191ca8270f51)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:04.826731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:04.957858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=32 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:05.086193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910335d588824554b1c5191ca8270f51'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:05.087104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910335d588824554b1c5191ca8270f51'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:05.099828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910335d588824554b1c5191ca8270f51'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:05.179877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910335d588824554b1c5191ca8270f51'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:05.180499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910335d588824554b1c5191ca8270f51'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:05.194459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1176/2373] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:04 2022] DELETE /identity/v3/users/910335d588824554b1c5191ca8270f51 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:05.201227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:05.201513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:05.201785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:05.222587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:05.223934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:05.288040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1198/2374] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:05.297932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:05.300020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:05.330451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:05.363457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdafe6-f430-4a8e-9ec4-3544084432d5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:05.366316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:05.367002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:05.367344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:05.367701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:05.382899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:05.384342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:05.394888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1177/2375] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:05.814596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:05.816094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:05.829437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392be563-54d5-4b1b-b001-e6d3a9b12469 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:05.836513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:05.836513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:05.836513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:05.836513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] PATH_INFO: `/v3/projects/0c2a708479cc40d1ae36a20c67fe85ad` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:05.837060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2a708479cc40d1ae36a20c67fe85ad)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:05.838362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:05.951748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2a708479cc40d1ae36a20c67fe85ad', 'request_id': 'req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:06.019519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2a708479cc40d1ae36a20c67fe85ad', 'request_id': 'req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:06.026102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2a708479cc40d1ae36a20c67fe85ad', 'request_id': 'req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:06.036437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] The token cache is being invalidate because project 0c2a708479cc40d1ae36a20c67fe85ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:06.036726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:06.037380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cf68bec3-e3a8-4a3e-8e1d-4fdc3d25a3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:06.038915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1199/2376] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:05 2022] DELETE /identity/v3/projects/0c2a708479cc40d1ae36a20c67fe85ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:15.991007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=15 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:16.033366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:16.230446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:16.233822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:16.244524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04250-bed1-4a62-bd5f-280f0d10d7c1 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:16.302718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:16.303365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:16.303640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:16.303922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] PATH_INFO: `/v3/users/e9b628d987394c028cb6e7a761d5d3cd` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:16.305041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b628d987394c028cb6e7a761d5d3cd)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:16.306982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:16.473153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b628d987394c028cb6e7a761d5d3cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:16.473804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b628d987394c028cb6e7a761d5d3cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:16.486598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b628d987394c028cb6e7a761d5d3cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:16.562227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b628d987394c028cb6e7a761d5d3cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:16.562789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b628d987394c028cb6e7a761d5d3cd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:16.575053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1178/2377] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:50:16 2022] DELETE /identity/v3/users/e9b628d987394c028cb6e7a761d5d3cd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:16.579520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:16.579808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:16.580079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:16.599197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:16.600384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:16.658450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1200/2378] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:16.668722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:16.670102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:16.729276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998683-df23-4262-9c30-1e9429568b3b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:16.732885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:16.733498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:16.733770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:16.734035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:16.743069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:16.744478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872bb71-591c-4689-bd59-e0b51b111921 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:16.754248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1179/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:50:17.158472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:17.160090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:17.173208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6752b3-f50b-4c7c-ae7c-5584c454f72f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:17.178094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:17.178758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:17.179034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:17.179304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] PATH_INFO: `/v3/projects/6c80cd3f9d1846f681161b53ea5334a2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:17.180441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c80cd3f9d1846f681161b53ea5334a2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:17.182386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:17.326436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c80cd3f9d1846f681161b53ea5334a2', 'request_id': 'req-aee26bc8-9dad-4f0c-b2de-4451590fbc76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:17.429195 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c80cd3f9d1846f681161b53ea5334a2', 'request_id': 'req-aee26bc8-9dad-4f0c-b2de-4451590fbc76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:17.435959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c80cd3f9d1846f681161b53ea5334a2', 'request_id': 'req-aee26bc8-9dad-4f0c-b2de-4451590fbc76'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:17.446396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] The token cache is being invalidate because project 6c80cd3f9d1846f681161b53ea5334a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:50:17.446690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:17.447327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:50:17.449383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1201/2380] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:50:17 2022] DELETE /identity/v3/projects/6c80cd3f9d1846f681161b53ea5334a2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:50:17.633994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218d79-1b2c-4450-ad78-8a3213fb31e4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:17.634486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218d79-1b2c-4450-ad78-8a3213fb31e4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:17.634595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35218d79-1b2c-4450-ad78-8a3213fb31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:17.654588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-35218d79-1b2c-4450-ad78-8a3213fb31e4 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:17.655778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-35218d79-1b2c-4450-ad78-8a3213fb31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:17.678336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:17.716215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1180/2381] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:50:17.728946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:17.730583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:17.802681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26bc8-9dad-4f0c-b2de-4451590fbc76 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:50:17.808453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:50:17.808972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:17.809250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:17.809519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:17.824148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:50:17.825769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:50:17.835537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1202/2382] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:50:27.832033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:27.871504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=15 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:48.513802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd60c-217e-42af-970d-1e2807416713 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:50:48.514458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd60c-217e-42af-970d-1e2807416713 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:50:48.514710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd60c-217e-42af-970d-1e2807416713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:50:48.535240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-14ecd60c-217e-42af-970d-1e2807416713 None None] MFA Rules not processed for user `9767d18cf0944f16b45fff4214128c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:50:48.536413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-14ecd60c-217e-42af-970d-1e2807416713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:50:48.587983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1181/2383] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:50:58.581752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=25 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:50:59.922849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:50:59.924493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:00.012945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c197d9a-0016-4038-ac8a-ce520865c82e service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:00.018021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:00.018675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:00.018952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:00.019223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:00.020976 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:00.033701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:00.035328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7976061-d5b3-403a-8f48-5cc9b09eee15 service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:00.046545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1203/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:50:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:51:04.403114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:04.403598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:04.403738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:04.422240 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] MFA Rules not processed for user `36a40c9d61174c38b007ba0a30fc95c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:04.423505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:04.478368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1182/2385] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:10.042012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=32 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:14.471311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=25 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:30.492458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:30.492984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:30.492984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:30.513434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] MFA Rules not processed for user `5b1db5be49014d2cba63cdee9df5b1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:30.514679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:30.571378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1204/2386] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:40.564245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=25 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:51.642198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:51.643581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:51.698020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391272d-81b5-4d24-bb6c-5b501e3e105c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:51.701550 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:51.702139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:51.702447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:51.702717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:51.704390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:51.764837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:51.766818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:51.776164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1183/2387] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:51:55.533400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:55.535117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:55.552254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f686c-5cdf-4628-9b63-8098cb08997e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:55.555196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:55.555833 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:55.556109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:55.556376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] PATH_INFO: `/v3/users/9767d18cf0944f16b45fff4214128c1a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:55.557506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9767d18cf0944f16b45fff4214128c1a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:55.559477 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:55.813642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9767d18cf0944f16b45fff4214128c1a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:55.825503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9767d18cf0944f16b45fff4214128c1a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:55.899954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9767d18cf0944f16b45fff4214128c1a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:55.900593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9767d18cf0944f16b45fff4214128c1a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:55.901196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10c19d6b-6d98-4400-8a39-71e94e256929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9767d18cf0944f16b45fff4214128c1a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:55.914364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1205/2388] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:51:55 2022] DELETE /identity/v3/users/9767d18cf0944f16b45fff4214128c1a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:56.181683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.193349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9be5a-744e-42e6-84f0-faf0720438ed service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.251556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.252190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.252792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.253089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] PATH_INFO: `/v3/projects/30bf0498eabd4d9988b2084c0b082fad` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.254614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bf0498eabd4d9988b2084c0b082fad)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.256169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:56.373995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bf0498eabd4d9988b2084c0b082fad', 'request_id': 'req-2453d535-14a9-4ccc-953c-5459022160dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:56.376521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:56.381220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bf0498eabd4d9988b2084c0b082fad', 'request_id': 'req-2453d535-14a9-4ccc-953c-5459022160dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:56.485439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bf0498eabd4d9988b2084c0b082fad', 'request_id': 'req-2453d535-14a9-4ccc-953c-5459022160dd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:56.496675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] The token cache is being invalidate because project 30bf0498eabd4d9988b2084c0b082fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:51:56.496962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:56.497629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-2453d535-14a9-4ccc-953c-5459022160dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:56.499129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1184/2389] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:51:56 2022] DELETE /identity/v3/projects/30bf0498eabd4d9988b2084c0b082fad => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:56.504261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.504549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.504824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.527567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:56.527567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:56.586005 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1206/2390] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:56.593839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.594777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.595054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.614622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:56.615867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:56.624698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.624971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1185/2391] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:56.626099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:56.629798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.639085 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c3f85-8155-47b0-b6b3-a27e6c2ec6fa None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.644975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.645556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.645837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.646106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.646772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:51:56.647120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.648699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:56.660952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1186/2392] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:51:56.665426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.675614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817866-7046-4da7-9d82-e33ee3db2326 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.680504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.681081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.681355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.681954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.682622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.684478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:56.684829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7c586-6663-410f-bb54-e1bd465983e4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.688974 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.689575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.689851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.690125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.691908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:56.721102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:56.765476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1187/2393] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:51:56 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:51:56.767240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.768695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:56.770492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.780145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1207/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:51:56.831448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66fd0c-2646-499b-bc31-2adaf11f4372 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.836160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.836759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.837034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.837303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.837924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.839870 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:56.961043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1188/2395] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:51:56 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:51:56.965470 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:56.976340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf81c4-49a9-4f00-b128-34e577672312 service glance] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:56.986908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:56.989955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:56.989955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:56.989955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:56.989955 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:56.990362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.008147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1208/2396] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:51:57.009247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.035909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51080-dc0d-4d49-8c1d-f68f66e44390 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.040076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.040807 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.041191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.041461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.042097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.043746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.054866 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1189/2397] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:51:57.059381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.068539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.070290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:57.070468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c66b9-721b-4258-bf72-dc4ebd1f9bbf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.075617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.076268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.076544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.076817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] PATH_INFO: `/v3/projects/183b2608569d489da3375a38cbee3d1d/users/e19e5d21b9104540a2ad12040981bca6/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.094264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183b2608569d489da3375a38cbee3d1d, user_id=e19e5d21b9104540a2ad12040981bca6, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.097111 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50574c3-b9b2-4ec7-af9f-0792baf5dca3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.130612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21077d4-cb6c-4aeb-b3e8-426ff1810246 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.134311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.134946 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.135229 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.135605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.137353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:57.166846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1209/2398] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:51:57 2022] PUT /identity/v3/projects/183b2608569d489da3375a38cbee3d1d/users/e19e5d21b9104540a2ad12040981bca6/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:57.168286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:57.177931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.178243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.178609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.206965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] MFA Rules not processed for user `e19e5d21b9104540a2ad12040981bca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:57.208157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.208646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:57.209659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.221453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1190/2399] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:51:57.277362 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1210/2400] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:57.282009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.293019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b444-2946-40d8-9351-f70f6d51b1e1 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.351375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.352052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.352396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.352674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.353556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.355463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.479100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1191/2401] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:51:57 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:51:57.483445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.494699 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44303-f5bc-48b7-9595-63af18f636e7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.550664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.551199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.551487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.551759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.552395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.554513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.723636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:57.733226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1211/2402] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:51:57 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:51:57.740625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.745100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f67e-eb3a-4719-8f8e-9a6f94d5fe6f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.749682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.750319 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.750599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.750872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.751504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.753282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.764583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1192/2403] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:51:57.769149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.779164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5ee2e-c3b8-4ca9-9730-0712cb2ce06e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.784351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.785001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.785283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.785556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] PATH_INFO: `/v3/projects/100bb3a15c8142cf9c43b37f46f5176d/users/877ba5b8390b45929b4069b1719408f4/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.801602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100bb3a15c8142cf9c43b37f46f5176d, user_id=877ba5b8390b45929b4069b1719408f4, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.804309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.892071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1212/2404] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:51:57 2022] PUT /identity/v3/projects/100bb3a15c8142cf9c43b37f46f5176d/users/877ba5b8390b45929b4069b1719408f4/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:57.896081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.905984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc33e0-fff5-4827-8627-399518284b1b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:57.961428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:57.962027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:57.962317 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:57.962591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:57.963218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:57.964842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbfd66-1b68-45b4-9a26-00f18446f198 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:57.975684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1193/2405] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:51:57.980621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:57.997758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f656a7-597b-41bc-99a1-a70e2da1a800 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:58.002821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:58.003491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:58.003768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:58.004042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] PATH_INFO: `/v3/projects/100bb3a15c8142cf9c43b37f46f5176d/users/877ba5b8390b45929b4069b1719408f4/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:58.005959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=100bb3a15c8142cf9c43b37f46f5176d, user_id=877ba5b8390b45929b4069b1719408f4, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:58.008750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:58.019952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1213/2406] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:51:57 2022] PUT /identity/v3/projects/100bb3a15c8142cf9c43b37f46f5176d/users/877ba5b8390b45929b4069b1719408f4/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:58.032241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:58.036345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:58.036345 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:58.060238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] MFA Rules not processed for user `877ba5b8390b45929b4069b1719408f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:58.061379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:58.077138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:58.126498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1194/2407] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:51:58.137600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:58.139379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:58.195921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38d72-6f3c-4cd0-9dc6-bc2d7b01c4ef admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:58.199512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:58.200096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:58.200369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:58.200637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:58.210750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:58.212311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff67a5-922f-4158-8702-a085095e6b5d service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:58.222151 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1214/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:51:59.234042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:59.296270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f15a70-855d-4467-84ab-5dc5df078a0c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:59.300805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:59.301428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:59.301708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:59.301977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] PATH_INFO: `/v3/users/e19e5d21b9104540a2ad12040981bca6` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:59.303114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19e5d21b9104540a2ad12040981bca6)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:59.305023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:59.519547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19e5d21b9104540a2ad12040981bca6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:59.520257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19e5d21b9104540a2ad12040981bca6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:59.532503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19e5d21b9104540a2ad12040981bca6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:59.611231 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19e5d21b9104540a2ad12040981bca6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:59.611904 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19e5d21b9104540a2ad12040981bca6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:51:59.625083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1195/2409] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:51:59 2022] DELETE /identity/v3/users/e19e5d21b9104540a2ad12040981bca6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:51:59.629984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:59.630528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:59.630528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:59.655703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:51:59.657495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:59.719403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1215/2410] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:51:59.729555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:51:59.730954 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:51:59.767814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:51:59.788041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e94030-0072-4c4c-b08d-8fd0dbb52494 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:51:59.791531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:51:59.792120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:51:59.792387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:51:59.792650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:51:59.801656 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:51:59.803084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:51:59.813090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1196/2411] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:00.244260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:00.245741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:00.258840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d65fb0-b4f3-4877-abc5-7edaedab9021 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:00.263711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:00.269423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:00.269423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:00.269423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] PATH_INFO: `/v3/projects/183b2608569d489da3375a38cbee3d1d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:00.269423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183b2608569d489da3375a38cbee3d1d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:00.269423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:00.402788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183b2608569d489da3375a38cbee3d1d', 'request_id': 'req-790777c4-b685-4e9a-8813-98d087eee845'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.539844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183b2608569d489da3375a38cbee3d1d', 'request_id': 'req-790777c4-b685-4e9a-8813-98d087eee845'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.542129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:00.546842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183b2608569d489da3375a38cbee3d1d', 'request_id': 'req-790777c4-b685-4e9a-8813-98d087eee845'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.557965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] The token cache is being invalidate because project 183b2608569d489da3375a38cbee3d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:00.564065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.564065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.564065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1216/2412] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:00 2022] DELETE /identity/v3/projects/183b2608569d489da3375a38cbee3d1d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:00.564508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:00.574057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4bed2-bdeb-49e8-a036-3760c12ca3f3 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:00.628987 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:00.629600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:00.629873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:00.630142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] PATH_INFO: `/v3/users/877ba5b8390b45929b4069b1719408f4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:00.631260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877ba5b8390b45929b4069b1719408f4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:00.633148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:00.813615 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877ba5b8390b45929b4069b1719408f4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.814343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877ba5b8390b45929b4069b1719408f4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.828955 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877ba5b8390b45929b4069b1719408f4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.905285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877ba5b8390b45929b4069b1719408f4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.905892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-1ee12372-0d45-4eaf-a380-29360dda1b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877ba5b8390b45929b4069b1719408f4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:00.919271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1197/2413] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:00 2022] DELETE /identity/v3/users/877ba5b8390b45929b4069b1719408f4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:01.357465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:01.357465 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:01.367143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790777c4-b685-4e9a-8813-98d087eee845 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:01.427364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:01.427993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.428272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.428563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] PATH_INFO: `/v3/projects/100bb3a15c8142cf9c43b37f46f5176d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.429701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100bb3a15c8142cf9c43b37f46f5176d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:01.431654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:01.542996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100bb3a15c8142cf9c43b37f46f5176d', 'request_id': 'req-4a75c677-3a40-4454-8fec-71c96281e0f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:01.613798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100bb3a15c8142cf9c43b37f46f5176d', 'request_id': 'req-4a75c677-3a40-4454-8fec-71c96281e0f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:01.620199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100bb3a15c8142cf9c43b37f46f5176d', 'request_id': 'req-4a75c677-3a40-4454-8fec-71c96281e0f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:01.631008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] The token cache is being invalidate because project 100bb3a15c8142cf9c43b37f46f5176d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:01.631293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:01.631910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a75c677-3a40-4454-8fec-71c96281e0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:01.633456 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1217/2414] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:01 2022] DELETE /identity/v3/projects/100bb3a15c8142cf9c43b37f46f5176d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:01.638459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.638993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.638993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.665641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:01.666851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:01.716794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:01.728031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1198/2415] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:01.736458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.736744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.737110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.757372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:01.758626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:01.766939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1218/2416] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:01.771235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:01.781251 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77268d-ce7f-46d1-a478-5bdb7499267b None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:01.786385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:01.786968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.787239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.787503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.788135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:52:01.788428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:01.790029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:01.801384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1199/2417] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:52:01.805463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:01.814733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ced7c-cb3f-4cb5-9405-2fabcb07b040 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:01.819383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:01.819967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.820238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.820502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.821106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:01.823030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:01.913056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1219/2418] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:01 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:01.916605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:01.926861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9e83f-b77c-4ac4-a052-044887dc08a3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:01.986453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:01.987087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:01.987357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:01.987623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:01.988230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:01.990113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.093975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1200/2419] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:01 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:02.098088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.108612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038cc66-f57a-4699-84bc-abd4167e4631 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.113382 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.113966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.114271 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.114544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.115200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.116854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.127129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1220/2420] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:02.131066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.140847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50216b-0187-4d25-8a7e-102292d3e74b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.146018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.146640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.146934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.147182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.147808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.149377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc299a-eaa7-453f-bf54-e1d0da1ce038 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.159706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1201/2421] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:02.163574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.173257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046b527-7220-4731-b84d-5fbc8df5db39 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.177797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.178457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.178730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.178998 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] PATH_INFO: `/v3/projects/5fa67b778c64477f93aca19dc8595f14/users/4ebab2e096f84fb98eb9e033f8eb5134/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.193313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa67b778c64477f93aca19dc8595f14, user_id=4ebab2e096f84fb98eb9e033f8eb5134, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.195950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.315426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1221/2422] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:02 2022] PUT /identity/v3/projects/5fa67b778c64477f93aca19dc8595f14/users/4ebab2e096f84fb98eb9e033f8eb5134/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:02.325597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.325908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.326233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.353078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] MFA Rules not processed for user `4ebab2e096f84fb98eb9e033f8eb5134`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:02.354328 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:02.417218 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1202/2423] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:02.421894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.435598 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:02.489180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9664249-bbd6-46af-8ba9-4fdb5ba4d319 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.493787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.494412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.494694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.494963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.495584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.497506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.604819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1222/2424] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:02 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:02.608864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.620395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393473ac-8525-4340-bb21-162a82b7aef1 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.665758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:02.676770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.677360 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.677634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.677903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.678564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.680461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.765372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1203/2425] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:02 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:02.769625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.780075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4ef2-9513-49d3-bce8-71db2d9f2d86 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.785359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.785943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.786248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.786522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.787148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.788728 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.800606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1223/2426] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:52:02.808619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.818438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723958e8-0476-4617-9429-34e34f047a8e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.822976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.823557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.823830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.824092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.824716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.826311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a28ba-5e8d-46f6-a349-7be59c444a20 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.836089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1204/2427] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:52:02.840159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:02.850708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fadbf8-8cf7-40fa-9afa-f13a89ee109f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:02.855703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:02.856292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.856575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.856849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] PATH_INFO: `/v3/projects/2c009dcf70674fc19d2b515ff79b9e4a/users/b3ba791cc7314269a453ddeb6460e415/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:02.872270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c009dcf70674fc19d2b515ff79b9e4a, user_id=b3ba791cc7314269a453ddeb6460e415, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:02.874969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:02.963147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1224/2428] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:02 2022] PUT /identity/v3/projects/2c009dcf70674fc19d2b515ff79b9e4a/users/b3ba791cc7314269a453ddeb6460e415/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:02.975395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:02.975680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:02.975949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.004063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] MFA Rules not processed for user `b3ba791cc7314269a453ddeb6460e415`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:03.005257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:03.067705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1205/2429] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:03.072212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.137038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b719f9-1139-4fe9-8317-cda923d2854c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.141789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.143080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.143359 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.143626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.144255 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.146205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.241155 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1225/2430] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:03 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:03.245150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.255699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8719b-1b22-46c8-8f93-d0d9e1bf08b6 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.315752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.316478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.316613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.316880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.317501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.319465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.443952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1206/2431] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:03 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:03.445245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.456866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1e7b-91cf-49f3-a17e-fa34661c6eb5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.461737 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.462396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.462657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.462926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.463554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.465157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.476597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1226/2432] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:03.481180 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.491679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888be2-abea-4ae2-aa1e-8c2672152a84 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.496362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.497017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.497292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.497565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] PATH_INFO: `/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14/users/cb0101b2491c4888bc215b61477ad2ff/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.512678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0251b99ffa4f8f80d382f30ef31a14, user_id=cb0101b2491c4888bc215b61477ad2ff, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.515295 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.632483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1207/2433] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:03 2022] PUT /identity/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14/users/cb0101b2491c4888bc215b61477ad2ff/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:03.636449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.647192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9acc2f-9474-4434-8a48-12b06c4712cf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.679136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:03.701814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.702453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.702736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.703010 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.703641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.705859 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48174083-f838-4b25-8df8-2fdaa8778c25 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.717249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1227/2434] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:03.719830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.730435 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b5a16-2b09-4acc-83c2-7959076862f3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.735043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.736223 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.736499 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.736766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] PATH_INFO: `/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14/users/cb0101b2491c4888bc215b61477ad2ff/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.738672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0251b99ffa4f8f80d382f30ef31a14, user_id=cb0101b2491c4888bc215b61477ad2ff, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.741387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.752287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1208/2435] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:03 2022] PUT /identity/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14/users/cb0101b2491c4888bc215b61477ad2ff/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:03.762315 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.762610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.762891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.789773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] MFA Rules not processed for user `cb0101b2491c4888bc215b61477ad2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:03.791007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:03.861337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1228/2436] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:03.872535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:03.874210 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:03.888387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:03.931977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ccdc5-8fc5-46f9-a87b-2229bdd0f20a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:03.935623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:03.936214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:03.936488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:03.936754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:03.946410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:03.947828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:03.957087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1209/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:05.069046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:05.070500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:05.083397 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e23606-1694-47ee-9e76-ddef2152db43 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:05.087091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:05.087698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:05.088099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:05.088378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:05.148499 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:05.150081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:05.159938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1229/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:09.209777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:09.211178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:09.281808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5eb7-50bc-4193-8b8a-832004614997 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:09.287811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:09.288458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:09.288737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:09.289510 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:09.290782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:09.362645 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:09.364230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:09.373430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1210/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:10.141205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:10.151657 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11804-b648-41c6-a834-952c12e82d74 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:10.153560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:10.154149 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:10.154460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:10.154732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:10.209211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:10.211593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:10.213053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcdea-803d-4fd9-bb4c-b6decc04e802 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:10.221880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1230/2440] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:14.305375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:14.359507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:14.371580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384922-65c6-46b7-9d14-81c4f0b8f69f service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:14.376606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:14.377426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:14.377713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:14.377983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] PATH_INFO: `/v3/users/4ebab2e096f84fb98eb9e033f8eb5134` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:14.379167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebab2e096f84fb98eb9e033f8eb5134)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:14.382029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:14.564908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebab2e096f84fb98eb9e033f8eb5134'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:14.565587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebab2e096f84fb98eb9e033f8eb5134'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:14.577886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebab2e096f84fb98eb9e033f8eb5134'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:14.682448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebab2e096f84fb98eb9e033f8eb5134'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:14.683060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebab2e096f84fb98eb9e033f8eb5134'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:14.695763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1211/2441] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:14 2022] DELETE /identity/v3/users/4ebab2e096f84fb98eb9e033f8eb5134 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:14.700340 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:14.700799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:14.701054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:14.721076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:14.722296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:14.786472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1231/2442] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:14.799711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:14.801378 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:14.863564 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52be7a5-4f89-4d98-b5ee-4ba6e4d0924e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:14.867234 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:14.867833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:14.868104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:14.868372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:14.877309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:14.878806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec731b7-c665-42f8-aa1c-6cc28569e430 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:14.889830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1212/2443] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:15.290890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:15.299223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:15.304749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d968bb-cb25-464d-b735-fb8f3a962e72 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:15.315682 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:15.316349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:15.316648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:15.319894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] PATH_INFO: `/v3/projects/5fa67b778c64477f93aca19dc8595f14` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:15.319894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa67b778c64477f93aca19dc8595f14)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:15.321484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:15.350961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:15.351501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:15.351616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:15.372199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:15.373387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:15.432055 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1213/2444] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:15.464248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa67b778c64477f93aca19dc8595f14', 'request_id': 'req-f9bca7eb-1260-4270-ae8d-133b6583e915'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.582152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa67b778c64477f93aca19dc8595f14', 'request_id': 'req-f9bca7eb-1260-4270-ae8d-133b6583e915'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.588805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa67b778c64477f93aca19dc8595f14', 'request_id': 'req-f9bca7eb-1260-4270-ae8d-133b6583e915'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.599176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] The token cache is being invalidate because project 5fa67b778c64477f93aca19dc8595f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:15.599491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.600121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.601608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1232/2445] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:15 2022] DELETE /identity/v3/projects/5fa67b778c64477f93aca19dc8595f14 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:15.606447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:15.612590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:15.613984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:15.618785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e653890-ef7d-4741-9de3-727025560b51 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:15.631466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:15.675664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:15.676384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:15.676662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:15.676931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] PATH_INFO: `/v3/users/b3ba791cc7314269a453ddeb6460e415` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:15.678660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ba791cc7314269a453ddeb6460e415)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:15.680569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:15.687171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bca7eb-1260-4270-ae8d-133b6583e915 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:15.692549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:15.693244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:15.693533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:15.693801 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:15.695817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:15.716053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:15.754705 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:15.756375 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:15.764521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1233/2446] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:52:15.867556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ba791cc7314269a453ddeb6460e415'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.868336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ba791cc7314269a453ddeb6460e415'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.883477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ba791cc7314269a453ddeb6460e415'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.976859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ba791cc7314269a453ddeb6460e415'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.977692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ba791cc7314269a453ddeb6460e415'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:15.997103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1214/2447] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:15 2022] DELETE /identity/v3/users/b3ba791cc7314269a453ddeb6460e415 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:16.573582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:16.575248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:16.596547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34785e1-aa12-4500-bc33-87df30d43269 service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:16.708764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:16.709715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:16.710007 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:16.710319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] PATH_INFO: `/v3/projects/2c009dcf70674fc19d2b515ff79b9e4a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:16.711557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c009dcf70674fc19d2b515ff79b9e4a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:16.713481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:16.852407 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c009dcf70674fc19d2b515ff79b9e4a', 'request_id': 'req-3635a0ee-2d44-47d0-aa5e-ee66897db455'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:16.950862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c009dcf70674fc19d2b515ff79b9e4a', 'request_id': 'req-3635a0ee-2d44-47d0-aa5e-ee66897db455'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:16.959380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c009dcf70674fc19d2b515ff79b9e4a', 'request_id': 'req-3635a0ee-2d44-47d0-aa5e-ee66897db455'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:16.971826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] The token cache is being invalidate because project 2c009dcf70674fc19d2b515ff79b9e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:16.972231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:16.976369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:16.981311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1234/2448] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:16 2022] DELETE /identity/v3/projects/2c009dcf70674fc19d2b515ff79b9e4a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:16.982573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:16.984306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:16.997961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b73c7-c47b-407a-a2ce-e46eee4c714e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:17.070664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:17.071344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:17.071623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:17.071894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] PATH_INFO: `/v3/users/cb0101b2491c4888bc215b61477ad2ff` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:17.073049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0101b2491c4888bc215b61477ad2ff)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:17.075034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:17.271137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0101b2491c4888bc215b61477ad2ff'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:17.271754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:17.272816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0101b2491c4888bc215b61477ad2ff'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:17.299222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0101b2491c4888bc215b61477ad2ff'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:17.396609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0101b2491c4888bc215b61477ad2ff'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:17.397241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-91627a49-69ba-4bd2-8fd4-3202cb02aa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0101b2491c4888bc215b61477ad2ff'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:17.416324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1215/2449] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:16 2022] DELETE /identity/v3/users/cb0101b2491c4888bc215b61477ad2ff => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:17.940675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:17.942873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:17.957607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a0ee-2d44-47d0-aa5e-ee66897db455 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:18.029897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:18.040108 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:18.040774 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.041211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.041561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] PATH_INFO: `/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.042780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0251b99ffa4f8f80d382f30ef31a14)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:18.045284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:18.159230 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0251b99ffa4f8f80d382f30ef31a14', 'request_id': 'req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:18.248014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0251b99ffa4f8f80d382f30ef31a14', 'request_id': 'req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:18.257236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0251b99ffa4f8f80d382f30ef31a14', 'request_id': 'req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:18.274592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] The token cache is being invalidate because project ae0251b99ffa4f8f80d382f30ef31a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:18.275063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:18.275849 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-89cb4c6a-2d36-4985-87b6-8b9996d12e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:18.277409 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1235/2450] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:17 2022] DELETE /identity/v3/projects/ae0251b99ffa4f8f80d382f30ef31a14 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:18.284620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.286332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.286332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.310082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:18.311482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:18.395047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1216/2451] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:18.405366 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.405806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.406154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.428580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:18.429836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:18.438584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1236/2452] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:18.442915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:18.454030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6158-f29a-4172-8da7-a700f21385cb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:18.459668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:18.460329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.460606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.460874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.461545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:52:18.468928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:18.468928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:18.476827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1217/2453] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:52:18.481678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:18.492244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3ce5-2123-4857-a66d-4e50d9985fb0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:18.497614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:18.498294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.498582 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.498858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.499498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:18.501443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:18.843840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1237/2454] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:18 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:18.848046 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:18.858587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf8dc7-a19c-42a8-b6d5-1ceb99114c65 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:18.915586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:18.916188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:18.916459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:18.916724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:18.917366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:18.919302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:19.003818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1218/2455] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:18 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:19.008749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:19.026750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d7f84-cabb-4a3f-a00e-8f8477967e8b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:19.038196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:19.038832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:19.039128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:19.039405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:19.040072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:19.042460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:19.071790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1238/2456] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:19.075778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:19.094549 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49783-97f5-4d72-8ff2-99603266870a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:19.108833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:19.109755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:19.110109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:19.110531 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:19.111868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:19.113661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b274afb-b37f-4100-bd77-157dfa97b1a2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:19.130224 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1219/2457] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:19.133460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:19.150740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53be4f-000d-4525-a60d-462095be7785 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:19.157670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:19.160786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:19.160786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:19.160786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] PATH_INFO: `/v3/projects/c3d7b34fdeb94fe19e2e77f78137a195/users/931eceeae0e84fc4ae0d46471b81b4c5/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:19.176349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d7b34fdeb94fe19e2e77f78137a195, user_id=931eceeae0e84fc4ae0d46471b81b4c5, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:19.179845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:19.243622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1239/2458] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:19 2022] PUT /identity/v3/projects/c3d7b34fdeb94fe19e2e77f78137a195/users/931eceeae0e84fc4ae0d46471b81b4c5/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:19.248838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9b00-cca2-450c-ac4a-f6b387d2473a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:19.249125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9b00-cca2-450c-ac4a-f6b387d2473a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:19.249400 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9b00-cca2-450c-ac4a-f6b387d2473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:19.272556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-88cb9b00-cca2-450c-ac4a-f6b387d2473a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:19.273790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-88cb9b00-cca2-450c-ac4a-f6b387d2473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:19.296661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:19.343861 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1220/2459] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:19.354263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:19.356058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:19.427134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a018-e833-4e92-ba86-9a9126875a6b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:19.434813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:19.438280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:19.438280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:19.438280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:19.448274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:19.450102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:19.466808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1240/2460] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:20.974078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b5e-f270-40f1-a054-186b25745519 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:20.975593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b5e-f270-40f1-a054-186b25745519 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:20.976090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279b5e-f270-40f1-a054-186b25745519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.018796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-54279b5e-f270-40f1-a054-186b25745519 None None] MFA Rules not processed for user `931eceeae0e84fc4ae0d46471b81b4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:21.020137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-54279b5e-f270-40f1-a054-186b25745519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:21.121265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1221/2461] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:21.125542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:21.144447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a72e8-c601-42e7-8d40-682547575b9b service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:21.154962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:21.156049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:21.156453 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:21.156830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.161385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:21.165702 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:21.259604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:21.274502 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1241/2462] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:21 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:21.275792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279b5e-f270-40f1-a054-186b25745519 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:21.293514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279b5e-f270-40f1-a054-186b25745519 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:21.376798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:21.377333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:21.377613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:21.377887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.378557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:21.380497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:21.478319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:21.480945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:21.518627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1222/2463] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:21 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:21.524990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:21.543695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2a02f-a491-4e8a-b00f-9f6d24a2a6d0 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:21.553003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:21.554922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:21.554922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:21.555106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.556056 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:21.559561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:21.579124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1223/2464] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:21.586302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:21.608134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c6f6-7894-43d3-b4ef-140507344ebc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:21.614880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:21.638341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:21.638341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:21.638341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.638341 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:21.638886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3971-dfdc-4a8d-9985-dba00b4bc90d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:21.649368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:21.650051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:21.650369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:21.650661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] PATH_INFO: `/v3/projects/674f7967f4b4472c8f493e168bd353c1/users/15129ec0f6c642c7804679d6d08856f5/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:21.681556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674f7967f4b4472c8f493e168bd353c1, user_id=15129ec0f6c642c7804679d6d08856f5, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:21.684461 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:21.731180 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:21.733258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:21.744082 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1242/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:22.160088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1224/2466] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:21 2022] PUT /identity/v3/projects/674f7967f4b4472c8f493e168bd353c1/users/15129ec0f6c642c7804679d6d08856f5/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:22.164281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:22.174622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff78d-7fbe-4744-b65b-1eb76ba5bd3f service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:22.233755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:22.234389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:22.234664 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:22.234936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:22.235558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:22.237240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9cf5d-f0f1-430f-917c-92c8595b7543 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:22.247433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1243/2467] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:22.251869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:22.263077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ccc9-2bf0-4578-85fa-6babc4d69c29 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:22.267751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:22.268404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:22.268680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:22.268948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] PATH_INFO: `/v3/projects/674f7967f4b4472c8f493e168bd353c1/users/15129ec0f6c642c7804679d6d08856f5/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:22.270916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674f7967f4b4472c8f493e168bd353c1, user_id=15129ec0f6c642c7804679d6d08856f5, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:22.273543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:22.275920 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:22.286098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1225/2468] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:22 2022] PUT /identity/v3/projects/674f7967f4b4472c8f493e168bd353c1/users/15129ec0f6c642c7804679d6d08856f5/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:23.879143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:23.879968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:23.880420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:24.128277 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] MFA Rules not processed for user `15129ec0f6c642c7804679d6d08856f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:24.131958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:24.166476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:24.309432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1244/2469] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:24.322720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:24.324434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:24.399556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81d5-b63d-4b44-b7e3-94dc522af981 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:24.420415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:24.421057 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:24.421334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:24.421602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:24.515200 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:24.516930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:24.531620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1226/2470] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:26.744171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:26.745662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:26.757539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ffbc5-08d1-4880-b5de-17b929d9c126 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:26.761270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:26.761907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:26.762193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:26.762473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:26.772406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:26.773827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf796e-9014-4a44-a2d9-7c0d9d7cc967 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:26.784106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1245/2471] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:27.714460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:27.771847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a174a-87df-41ea-8528-b61198860814 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:27.775576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:27.776177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:27.776453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:27.776722 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:27.778573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:27.789021 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:27.790590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f07f2b-d5ae-4a20-898b-fa9ccfad317a service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:27.798978 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1227/2472] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:33.667461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:33.667991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:33.667991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:33.670487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1246/2473] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:52:33.678027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4638-8fb5-40d7-837d-9e05e3d1969d None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:33.678611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4638-8fb5-40d7-837d-9e05e3d1969d None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:33.679007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4638-8fb5-40d7-837d-9e05e3d1969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:33.702993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-a46f4638-8fb5-40d7-837d-9e05e3d1969d None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:33.704232 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a46f4638-8fb5-40d7-837d-9e05e3d1969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:33.750540 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:33.776238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1228/2474] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:33.788041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:33.789749 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:33.847603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b86b-1969-4681-a128-a51568af5485 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:33.852017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:33.852614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:33.853166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:33.853435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:33.863540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:33.865628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8c8c-2157-4f47-857a-ce526d3fb0d1 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:33.876094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1247/2475] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:34.084002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.084288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.084556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] PATH_INFO: `/` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.086105 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1229/2476] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:52:34.091128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b91e-3892-458e-b991-76d5d175873c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.091406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b91e-3892-458e-b991-76d5d175873c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.091676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b91e-3892-458e-b991-76d5d175873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.112790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c8e0b91e-3892-458e-b991-76d5d175873c None None] MFA Rules not processed for user `17858a6841b14bc2bca713bbad4cc5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:34.114013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c8e0b91e-3892-458e-b991-76d5d175873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.121136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1248/2477] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:34.138134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:34.138134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.155185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ddc8a-bcda-44ba-bd49-daa65f605348 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:34.158930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:34.159581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.159881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.161043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.168453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:34.170160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeceb3-a9f0-48a6-aa1c-5d407b36dc0a service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:34.178278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1230/2478] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:34.259832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a154e-ad26-443a-99d8-3380ccbe261d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.260209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a154e-ad26-443a-99d8-3380ccbe261d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.260485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a154e-ad26-443a-99d8-3380ccbe261d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.261922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1249/2479] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 12:52:34.267692 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.276093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.276093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.289595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] MFA Rules not processed for user `2a09e02d84674a8282737d0411be459e`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:34.299062 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.300262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1231/2480] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:34.311107 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a154e-ad26-443a-99d8-3380ccbe261d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:34.322140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a154e-ad26-443a-99d8-3380ccbe261d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:34.325763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:34.326380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.326652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.326915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.337260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:34.341969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad884-4d3c-4ad6-8efd-e1bb956a0bcf service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:34.349081 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1250/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:34.410782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:34.412384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.479699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0247d6-c311-4fa9-87cf-32eb26faec8c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:34.484812 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:34.485410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:34.485688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:34.485961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:34.487735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:34.503784 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:34.506010 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:34.516113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1232/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:37.176617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c9fa-b249-4d85-8538-690e42a12fe7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:37.177647 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c9fa-b249-4d85-8538-690e42a12fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:37.177773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2c9fa-b249-4d85-8538-690e42a12fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:37.198122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f6b2c9fa-b249-4d85-8538-690e42a12fe7 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:37.199351 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f6b2c9fa-b249-4d85-8538-690e42a12fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:37.258612 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1251/2483] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:37.274624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:37.275828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:37.346397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3d937-b25e-4cf4-909f-123d1a6c1aef service placement] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:37.352141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:37.353095 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:37.353386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:37.353684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:37.362091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:37.363697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74960a-6253-4d34-af91-130338950b77 service swift] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:37.371897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1233/2484] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:52:42.688443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199953-a39e-4e4e-90d5-d4dd76930d9e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.688961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199953-a39e-4e4e-90d5-d4dd76930d9e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.689202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199953-a39e-4e4e-90d5-d4dd76930d9e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.690709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1252/2485] 10.222.0.15 () {54 vars in 921 bytes} [Mon Aug 22 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 12:52:42.703492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.705158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.705647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.734734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] MFA Rules not processed for user `f2887cf82974425388d18660bf964fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:42.736490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:42.746586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1234/2486] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Aug 22 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:42.764386 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199953-a39e-4e4e-90d5-d4dd76930d9e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:42.784458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199953-a39e-4e4e-90d5-d4dd76930d9e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:42.790365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:42.804601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:42.804601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:42.804601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:42.804601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:42.804601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:42.813426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1253/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:44.055982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:44.097541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:44.131629 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d703fa-5fe5-44b0-8a5f-2aae798bae9e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:44.136888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:44.137684 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:44.137966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:44.138270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] PATH_INFO: `/v3/users/931eceeae0e84fc4ae0d46471b81b4c5` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:44.139453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931eceeae0e84fc4ae0d46471b81b4c5)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:44.141527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:44.393667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931eceeae0e84fc4ae0d46471b81b4c5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.394265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931eceeae0e84fc4ae0d46471b81b4c5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.406442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931eceeae0e84fc4ae0d46471b81b4c5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.479641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931eceeae0e84fc4ae0d46471b81b4c5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.480773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931eceeae0e84fc4ae0d46471b81b4c5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:44.497885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1235/2488] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:44 2022] DELETE /identity/v3/users/931eceeae0e84fc4ae0d46471b81b4c5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:44.886498 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:44.899567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c9cb2-4e95-4eb8-bc21-cac0d03fe82e service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:44.924317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:44.971827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:44.972495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:44.972772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:44.973041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] PATH_INFO: `/v3/projects/c3d7b34fdeb94fe19e2e77f78137a195` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:44.974712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d7b34fdeb94fe19e2e77f78137a195)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:44.976592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:45.122770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d7b34fdeb94fe19e2e77f78137a195', 'request_id': 'req-58b0f44d-441f-465d-bec5-491b7e343001'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.242116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d7b34fdeb94fe19e2e77f78137a195', 'request_id': 'req-58b0f44d-441f-465d-bec5-491b7e343001'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.249830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d7b34fdeb94fe19e2e77f78137a195', 'request_id': 'req-58b0f44d-441f-465d-bec5-491b7e343001'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.262525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] The token cache is being invalidate because project c3d7b34fdeb94fe19e2e77f78137a195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:45.262857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.263474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.265300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1254/2489] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:44 2022] DELETE /identity/v3/projects/c3d7b34fdeb94fe19e2e77f78137a195 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:45.269235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:45.271342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:45.286934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b898f-2203-4b41-b9a6-b3b36ef57ee8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:45.349772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:45.350444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:45.350728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:45.350998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] PATH_INFO: `/v3/users/15129ec0f6c642c7804679d6d08856f5` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:45.352386 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=15129ec0f6c642c7804679d6d08856f5)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:45.354592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:45.665072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15129ec0f6c642c7804679d6d08856f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.668842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15129ec0f6c642c7804679d6d08856f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:45.672964 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:45.684646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15129ec0f6c642c7804679d6d08856f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.007119 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15129ec0f6c642c7804679d6d08856f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.007727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cfd82c18-6a90-4c7d-9d59-3d80f05b91cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15129ec0f6c642c7804679d6d08856f5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.020070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1236/2490] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:52:45 2022] DELETE /identity/v3/users/15129ec0f6c642c7804679d6d08856f5 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:46.292592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.292592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:46.304480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0f44d-441f-465d-bec5-491b7e343001 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:46.362357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:46.362990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.363268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.363539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] PATH_INFO: `/v3/projects/674f7967f4b4472c8f493e168bd353c1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.365150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674f7967f4b4472c8f493e168bd353c1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:46.367068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:46.554500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674f7967f4b4472c8f493e168bd353c1', 'request_id': 'req-1eef452c-73a3-4497-9f78-7bb94a252b79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.556163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:46.664145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674f7967f4b4472c8f493e168bd353c1', 'request_id': 'req-1eef452c-73a3-4497-9f78-7bb94a252b79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.671078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674f7967f4b4472c8f493e168bd353c1', 'request_id': 'req-1eef452c-73a3-4497-9f78-7bb94a252b79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.682049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] The token cache is being invalidate because project 674f7967f4b4472c8f493e168bd353c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:52:46.682360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.683004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1eef452c-73a3-4497-9f78-7bb94a252b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:52:46.684480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1255/2491] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:52:46 2022] DELETE /identity/v3/projects/674f7967f4b4472c8f493e168bd353c1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:52:46.689337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.689831 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.689944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.709523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:46.710748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:46.771558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1237/2492] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:46.779337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.779616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.779905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.799536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:46.800648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:46.808430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1256/2493] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:46.812687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.822466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0549cc-5d0e-44dc-803d-a01456ce33c3 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:46.826994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:46.827582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.827856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.828166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.828755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:52:46.829051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:46.830674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:46.842803 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1238/2494] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:52:46.846981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.857066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb154c-719a-4e14-8ca2-554befdd60d8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:46.861651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:46.862262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:46.862539 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:46.862808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:46.863416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:46.865286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:46.978166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1257/2495] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:52:46 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:52:46.982166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:46.993222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69153ff-0128-4c42-b924-9521c9b8198c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.059152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.059675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.059950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.060219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.060849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.062828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.230579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1239/2496] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:52:46 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:52:47.234845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:47.249377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee672e-f234-40d2-95eb-84951576c062 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.254467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.255098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.255895 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.256158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.256795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.258412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.273050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1258/2497] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:47.277238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:47.290731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2039d2-95e4-4fe2-911e-533fbc4c1d5c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.295323 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.298370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.298370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.298370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.298370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.298760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4f615-afa9-421e-84c2-a86ba7312311 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.311526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1240/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:52:47.315715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:47.326530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa4d06-f67a-43e8-bd50-663fd6f1de58 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.331099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.331745 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.332053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.332327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] PATH_INFO: `/v3/projects/0fa7ab184f2d475899be14a15bf9cb42/users/5c8054538c6f4e8ebb890075aa1b7283/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.347484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa7ab184f2d475899be14a15bf9cb42, user_id=5c8054538c6f4e8ebb890075aa1b7283, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.350229 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.413050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1259/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:52:47 2022] PUT /identity/v3/projects/0fa7ab184f2d475899be14a15bf9cb42/users/5c8054538c6f4e8ebb890075aa1b7283/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:52:47.418244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e513-a763-4733-81b1-844c26a297e0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.418534 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e513-a763-4733-81b1-844c26a297e0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.418806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e513-a763-4733-81b1-844c26a297e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.437581 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8122e513-a763-4733-81b1-844c26a297e0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:47.438900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8122e513-a763-4733-81b1-844c26a297e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:47.472141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:47.496995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1241/2500] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:47.506778 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:47.508488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:47.567177 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d2ee-26f8-40d4-9834-2b656f7c12ba admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:47.569962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:47.571199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:47.571482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:47.571754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:47.581052 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:47.582617 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:47.592581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1260/2501] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:48.991688 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:48.992999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:48.993482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.024636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] MFA Rules not processed for user `5c8054538c6f4e8ebb890075aa1b7283`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:49.025864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:49.097238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1242/2502] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:52:49.109295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:49.116290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:49.180015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6bce0-1d1d-4bd2-9d08-9965ce368ad3 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:49.187098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:49.187098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:49.187098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:49.187098 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:49.194732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:49.196283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0754a-0da9-4da4-94bb-da2681eff958 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:49.205803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1261/2503] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:50.269106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:50.270710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:50.346895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5bcb-bc30-426b-bc64-7fdcabb4a357 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:50.352367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:50.353213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:50.353488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:50.353817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:50.355532 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:50.368353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:50.371582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:50.381387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1243/2504] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:51.167665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07759-1027-4caf-b7e2-d5656671e586 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:51.168192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07759-1027-4caf-b7e2-d5656671e586 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:51.168289 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07759-1027-4caf-b7e2-d5656671e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:51.189889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-efa07759-1027-4caf-b7e2-d5656671e586 None None] MFA Rules not processed for user `5c8054538c6f4e8ebb890075aa1b7283`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:51.191331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-efa07759-1027-4caf-b7e2-d5656671e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:51.199554 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1262/2505] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:51.446963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:51.462442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc99a5-bad1-4bb1-8ee6-87b97dae3c63 service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:51.466030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:51.466668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:51.466943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:51.467213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:51.468939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:51.479432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:51.480849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:51.497070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1244/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:52:51.985231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:51.985231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:51.985231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:52.004945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:52:52.006912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:52.016000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:52.068630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1263/2507] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:52:52.085953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:52.087537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:52.138909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:52:52.165479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414af82-eb37-4894-82a7-70563efab55e service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:52.170794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:52.171474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:52.171748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:52.172017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:52.182422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:52.184206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:52.193282 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1245/2508] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:52:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:52:58.438235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:58.454922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b2e98-3fe5-43c7-94c7-86cac81c550d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:58.462933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:58.463799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:58.464290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:58.464762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:58.467221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:58.485486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:58.487401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:58.510944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1264/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:52:58.963016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:52:58.963016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:58.975843 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f261d2-17b4-45ee-a1d1-695827f033c5 service swift] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:52:58.982255 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:52:58.982864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:52:58.983162 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:52:58.983432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:52:58.985544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:52:58.998933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:52:59.000522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:52:59.026568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1246/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:07.149143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:07.158800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccdaa5-b8d3-4e98-a3b7-2ec04e5d10a3 service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:07.162929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:07.163514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:07.163786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:07.164050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:07.165720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:07.177257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:07.178746 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:07.189321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1265/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:09.016517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=19 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:11.551017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:11.553533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:11.573171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9330851-8a45-4a6a-9d22-eccbe6739d94 service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:11.577628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:11.578442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:11.578718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:11.579026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] PATH_INFO: `/v3/users/5b1db5be49014d2cba63cdee9df5b1d0` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:11.580140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1db5be49014d2cba63cdee9df5b1d0)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:11.582103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:11.815244 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1db5be49014d2cba63cdee9df5b1d0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.815906 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1db5be49014d2cba63cdee9df5b1d0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.830930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1db5be49014d2cba63cdee9df5b1d0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.947285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1db5be49014d2cba63cdee9df5b1d0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.947835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6693757e-5434-4a3d-8975-e40258c70d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1db5be49014d2cba63cdee9df5b1d0'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:11.962283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1247/2512] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:11 2022] DELETE /identity/v3/users/5b1db5be49014d2cba63cdee9df5b1d0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:12.222798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.233811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7118b-ec2f-45db-85f7-d2c11b581456 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.296171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.296805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.297080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.302012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] PATH_INFO: `/v3/projects/d2e81d9adcb6477aa19c0cbacca01351` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.302012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e81d9adcb6477aa19c0cbacca01351)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.302012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.414825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e81d9adcb6477aa19c0cbacca01351', 'request_id': 'req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.497748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e81d9adcb6477aa19c0cbacca01351', 'request_id': 'req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.504479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e81d9adcb6477aa19c0cbacca01351', 'request_id': 'req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.515524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] The token cache is being invalidate because project d2e81d9adcb6477aa19c0cbacca01351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:12.515890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.516676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e47b7e68-5e89-400d-8bd4-e3fa51f6f266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:12.518249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1266/2513] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:12 2022] DELETE /identity/v3/projects/d2e81d9adcb6477aa19c0cbacca01351 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:12.528918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.529202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.529476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.549020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:12.550265 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:12.608595 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1248/2514] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:12.616570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.616862 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.617140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.636960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:12.640184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:12.646099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1267/2515] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:12.650979 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.660867 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01f04f-a74a-42fd-becd-94008272b80c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.666289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.666878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.667150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.667438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.668073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:12.668368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.669937 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.682043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1249/2516] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:12.686172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.695635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6689f0-c8c8-44c4-afab-d49eee1e05b7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.700568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.701173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.701434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.701703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.702369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.704246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.720631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:12.840888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1268/2517] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:12.845591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:12.856931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45c64c-ca89-40c3-90ce-f26bf53498a5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:12.915092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:12.915720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:12.915989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:12.916264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:12.916897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:12.918881 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:12.926653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:13.034886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1250/2518] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:12 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:13.039532 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.049815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf876-b9ef-4208-90af-e14870bc8797 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.054483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.055075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.055347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.055614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.056292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.057908 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.067680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1269/2519] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:13.075752 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.086239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524f62-3697-4500-80a6-f813a81054b8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.091111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.091709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.092142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.092836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.093473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.095090 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13955b-bbec-42b9-9c32-80229834ecee admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.106507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1251/2520] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:13.110706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.120768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884f569-e07f-4441-8399-fcb7eecb79f2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.125356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.125981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.126300 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.126572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] PATH_INFO: `/v3/projects/e9e4366467b5436d9dcfe2618cd735cc/users/74e80391b8814b44b13a6b38d36b15ee/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.140659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e4366467b5436d9dcfe2618cd735cc, user_id=74e80391b8814b44b13a6b38d36b15ee, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.143321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.212168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1270/2521] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:13 2022] PUT /identity/v3/projects/e9e4366467b5436d9dcfe2618cd735cc/users/74e80391b8814b44b13a6b38d36b15ee/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:13.217081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900dd1e-f4d3-43ce-872f-5cf186e744b9 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.217362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900dd1e-f4d3-43ce-872f-5cf186e744b9 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.217633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900dd1e-f4d3-43ce-872f-5cf186e744b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.236922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0900dd1e-f4d3-43ce-872f-5cf186e744b9 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:13.238148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0900dd1e-f4d3-43ce-872f-5cf186e744b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:13.296827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1252/2522] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:13.306473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:13.308240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:13.364977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b27e-7a72-4111-8d4e-7d479fa79d95 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:13.368928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:13.369521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.369798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.370066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.379227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:13.380643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aeb6c-1ccb-4cab-9822-5183cbe9610f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:13.390517 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1271/2523] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:13.929707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3752c9a-9019-4db3-8833-26451913918a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:13.930139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3752c9a-9019-4db3-8833-26451913918a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:13.930285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3752c9a-9019-4db3-8833-26451913918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:13.950212 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f3752c9a-9019-4db3-8833-26451913918a None None] MFA Rules not processed for user `5c8054538c6f4e8ebb890075aa1b7283`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:13.951625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f3752c9a-9019-4db3-8833-26451913918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:14.013250 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1253/2524] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:19.462514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cee6-4155-46c9-a1ce-0de2216ff15f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:19.462986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cee6-4155-46c9-a1ce-0de2216ff15f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:19.463106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6cee6-4155-46c9-a1ce-0de2216ff15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:19.502432 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-98c6cee6-4155-46c9-a1ce-0de2216ff15f None None] MFA Rules not processed for user `74e80391b8814b44b13a6b38d36b15ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:19.504228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-98c6cee6-4155-46c9-a1ce-0de2216ff15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:19.608562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1272/2525] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:19.624333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3752c9a-9019-4db3-8833-26451913918a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:19.626766 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f3752c9a-9019-4db3-8833-26451913918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:19.714397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3752c9a-9019-4db3-8833-26451913918a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:19.720917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:19.721848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:19.722363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:19.722838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:19.732280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:19.734027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966707d-2830-4abd-847c-a8ddadf9241d service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:19.745150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1254/2526] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:53:22.333424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:22.335058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:22.335559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:22.357133 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] MFA Rules not processed for user `74e80391b8814b44b13a6b38d36b15ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:22.358437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:22.366309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1273/2527] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:29.740005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:INSERT=3,keystone:SELECT=93 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:32.350856 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=2,keystone:SELECT=78 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:38.593666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.594128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.594302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.626746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:38.628130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.708482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1255/2528] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:38.731094 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:38.732568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:38.836781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bbe6b-b668-4e3d-b387-7a8b4c19b641 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:38.841763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:38.842401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:38.842677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:38.842946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:38.850872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:38.852505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:38.860827 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1274/2529] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:39.838167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:39.880909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860a972-887d-4f32-bdd2-7313b7cfc7cc None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:39.885804 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:39.886562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:39.887049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:39.887500 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:39.889562 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:39.938883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:39.940655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:39.965157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1256/2530] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:44.662227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:44.664046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:44.688103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7168f7-57f8-4542-97f5-c846968d0152 service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:44.693641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:44.696260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:44.696874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:44.697494 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] PATH_INFO: `/v3/users/36a40c9d61174c38b007ba0a30fc95c3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:44.698957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a40c9d61174c38b007ba0a30fc95c3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:44.701268 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:44.990751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a40c9d61174c38b007ba0a30fc95c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.006367 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a40c9d61174c38b007ba0a30fc95c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.086113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a40c9d61174c38b007ba0a30fc95c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.086113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a40c9d61174c38b007ba0a30fc95c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.086818 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1dfce8a8-078d-4a6c-a8fc-3a50983d168d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a40c9d61174c38b007ba0a30fc95c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.119602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1275/2531] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:44 2022] DELETE /identity/v3/users/36a40c9d61174c38b007ba0a30fc95c3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:45.448678 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:45.464041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180317b-b892-4b21-be25-0a90d5d781e9 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:45.547221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:45.553996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:45.554661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:45.554929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] PATH_INFO: `/v3/projects/97408eeab80e45f9a27c405c23038f8c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:45.556431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97408eeab80e45f9a27c405c23038f8c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:45.558514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:45.677416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:45.700565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97408eeab80e45f9a27c405c23038f8c', 'request_id': 'req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:45.713445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97408eeab80e45f9a27c405c23038f8c', 'request_id': 'req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.080516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97408eeab80e45f9a27c405c23038f8c', 'request_id': 'req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.092660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] The token cache is being invalidate because project 97408eeab80e45f9a27c405c23038f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:46.092942 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.093597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-169306cf-d1fb-4a7b-8ac1-3ea6b07514c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:46.095157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1257/2532] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:45 2022] DELETE /identity/v3/projects/97408eeab80e45f9a27c405c23038f8c => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:46.100078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.100519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.100626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.130370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.131574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.156706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:46.214248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1276/2533] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:46.222421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.222983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.223246 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.245973 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.247151 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:46.262859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1258/2534] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:46.263954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.276651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a422-6272-48e9-a71e-bcd320a47c73 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.281552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.282171 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.282501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.287642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.288392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:46.289202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.291092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.305095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1277/2535] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:46.308994 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.318935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0f3d-8071-4ef9-af63-ce12a2993e2c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.323872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.324484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.324761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.325030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.325665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.327633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.460448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1259/2536] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:46.463142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.477999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f99a3f-54ba-41ab-9a91-5c7b14d44a20 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.571811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.572522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.572810 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.573087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.573720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.576142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.720072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1278/2537] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/users => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:46.724704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.738036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd37-aa37-4599-9203-2e4d390b5af3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.742871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.746694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.746694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.746694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.746694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.746694 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.758126 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1260/2538] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:46.762561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.774418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f13db-933d-4540-9ce1-624001d5f4f7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.779439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.780065 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.780323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.780848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.781376 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.783009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f5945-4b23-4923-8ffb-284dfe1ea588 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.801158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1279/2539] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:46.802838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:46.818950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c6f0-3a5c-4c34-b452-26990464d38b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:46.828517 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:46.829199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.829479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.829756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] PATH_INFO: `/v3/projects/06a550ede97c448ca877c124bcf3ff12/users/8f190ed6dc83411ab02b5bc596b112e6/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.850883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a550ede97c448ca877c124bcf3ff12, user_id=8f190ed6dc83411ab02b5bc596b112e6, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:46.854976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:46.946468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1261/2540] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:46 2022] PUT /identity/v3/projects/06a550ede97c448ca877c124bcf3ff12/users/8f190ed6dc83411ab02b5bc596b112e6/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:46.949552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:46.949906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:46.950279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:46.985283 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] MFA Rules not processed for user `8f190ed6dc83411ab02b5bc596b112e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:46.986785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:47.069395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1280/2541] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:47.074437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.151008 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdf1d5-ab93-4e9d-8461-212812f3da66 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.157422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.158263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.160267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.160267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.160267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.162392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.253123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1262/2542] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:47 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:47.257399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.280905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0fae-2aa8-4a21-935d-0645ae0aba76 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.299972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:47.355712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.356241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.356599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.356867 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.357506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.359780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.441433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1281/2543] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:47 2022] POST /identity/v3/users => generated 309 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:47.448290 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.463915 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12474335-cfb9-4bda-8a8a-04375ef5a539 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.470082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.470778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.471106 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.471537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.472225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.473998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.487609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1263/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:47.493484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.505592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49538a42-7ee4-4788-96a3-de85f4052156 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.512772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.513724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.514280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.514903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] PATH_INFO: `/v3/projects/48c7b93690eb4e8f9fa959235363f12c/users/87f5d303ed574994a83da2e480e0afdd/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.532636 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c7b93690eb4e8f9fa959235363f12c, user_id=87f5d303ed574994a83da2e480e0afdd, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.535823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.641160 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1282/2545] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:47 2022] PUT /identity/v3/projects/48c7b93690eb4e8f9fa959235363f12c/users/87f5d303ed574994a83da2e480e0afdd/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:47.645274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.656585 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9378-b94e-483f-a5de-6c8728a01b52 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.686504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:47.726886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.728698 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.729228 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.729707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.730646 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.732624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309c34-0714-4342-94b3-0c99833a3482 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.744490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1264/2546] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:47.751074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.765871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2f3bf-8b21-470b-9228-85ac01bbc76b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:47.771669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:47.772624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.772899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.773216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] PATH_INFO: `/v3/projects/48c7b93690eb4e8f9fa959235363f12c/users/87f5d303ed574994a83da2e480e0afdd/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.775232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c7b93690eb4e8f9fa959235363f12c, user_id=87f5d303ed574994a83da2e480e0afdd, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:47.779972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:47.794552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1283/2547] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:47 2022] PUT /identity/v3/projects/48c7b93690eb4e8f9fa959235363f12c/users/87f5d303ed574994a83da2e480e0afdd/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:47.807739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:47.808178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:47.808434 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:47.841778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] MFA Rules not processed for user `87f5d303ed574994a83da2e480e0afdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:47.843179 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:47.937778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1265/2548] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:47.945558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:47.947543 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:48.067808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed55a-f1f9-4b9f-b773-c0edbb0ceb25 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:48.072321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:48.072932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.073212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.073540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.083986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:48.085334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0d8f9-7ad6-44bb-8ad5-411ebf4cd935 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:48.095891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1284/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:48.280897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:48.370864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5eaa4-4bad-4cf2-9d73-832145773b7c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:48.377649 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:48.378511 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.379088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.379483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] PATH_INFO: `/v3/users/8f190ed6dc83411ab02b5bc596b112e6` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.380903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f190ed6dc83411ab02b5bc596b112e6)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:48.383631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:48.640896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f190ed6dc83411ab02b5bc596b112e6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.641795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f190ed6dc83411ab02b5bc596b112e6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.643777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:48.658666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f190ed6dc83411ab02b5bc596b112e6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.760109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f190ed6dc83411ab02b5bc596b112e6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.760754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f190ed6dc83411ab02b5bc596b112e6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:48.776384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1266/2550] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:48 2022] DELETE /identity/v3/users/8f190ed6dc83411ab02b5bc596b112e6 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:48.781024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.781609 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.781782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.806858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:48.808204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:48.868552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:48.880726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1285/2551] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:48.891543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:48.892990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:48.975217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64362-c569-45bf-a16d-9bbe6f863c2b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:48.980091 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:48.980706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:48.980985 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:48.981280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:48.990701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:48.992108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:49.002525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1267/2552] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:49.494373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:49.496286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:49.516243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af54b1-52ce-4be8-ba35-7c95843712df None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:49.523680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:49.530013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:49.530013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:49.530013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] PATH_INFO: `/v3/projects/06a550ede97c448ca877c124bcf3ff12` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:49.530013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a550ede97c448ca877c124bcf3ff12)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:49.530013 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:49.648247 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a550ede97c448ca877c124bcf3ff12', 'request_id': 'req-64f7511b-2013-4e03-b185-edea993cce03'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.735210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a550ede97c448ca877c124bcf3ff12', 'request_id': 'req-64f7511b-2013-4e03-b185-edea993cce03'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.744264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a550ede97c448ca877c124bcf3ff12', 'request_id': 'req-64f7511b-2013-4e03-b185-edea993cce03'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.757047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] The token cache is being invalidate because project 06a550ede97c448ca877c124bcf3ff12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:49.761374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.761374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:49.761374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1286/2553] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:49 2022] DELETE /identity/v3/projects/06a550ede97c448ca877c124bcf3ff12 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:49.764687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:49.778222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc379ce-1552-4662-b79c-6496443c4675 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:49.847355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:49.848069 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:49.848353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:49.848612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] PATH_INFO: `/v3/users/87f5d303ed574994a83da2e480e0afdd` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:49.849759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f5d303ed574994a83da2e480e0afdd)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:49.851748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.036949 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f5d303ed574994a83da2e480e0afdd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.037635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f5d303ed574994a83da2e480e0afdd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.051750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:50.054237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f5d303ed574994a83da2e480e0afdd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.129358 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f5d303ed574994a83da2e480e0afdd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.130076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-096c2e4d-e3f9-484b-a820-c72d4dbbffa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f5d303ed574994a83da2e480e0afdd'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.145857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1268/2554] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:49 2022] DELETE /identity/v3/users/87f5d303ed574994a83da2e480e0afdd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:50.613508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:50.615534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:50.642804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7511b-2013-4e03-b185-edea993cce03 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:50.719809 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:50.720662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:50.720984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:50.721278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] PATH_INFO: `/v3/projects/48c7b93690eb4e8f9fa959235363f12c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:50.722660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c7b93690eb4e8f9fa959235363f12c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:50.724652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:50.861891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c7b93690eb4e8f9fa959235363f12c', 'request_id': 'req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.975218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c7b93690eb4e8f9fa959235363f12c', 'request_id': 'req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:50.984863 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c7b93690eb4e8f9fa959235363f12c', 'request_id': 'req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.005851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] The token cache is being invalidate because project 48c7b93690eb4e8f9fa959235363f12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:51.006441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.007320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d3dc105c-7075-4dc7-8ee9-e49f93ff2dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:51.010095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1287/2555] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:50 2022] DELETE /identity/v3/projects/48c7b93690eb4e8f9fa959235363f12c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:51.014823 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.015347 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.015548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.058903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:51.060219 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:51.150614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1269/2556] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:51.157588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.158443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.158835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.174841 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:51.188873 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:51.192041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:51.207787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1288/2557] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:51.211670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.235399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885426e1-2784-4490-b25e-6a4dc5ab8aad None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.248451 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.249787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.250709 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.251609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.253073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:53:51.253808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.257351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.290865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1270/2558] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:53:51.292079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.301508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f8044-952d-4d21-b708-5ef0b701227a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.306973 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.307576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.307845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.308115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.308743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.310676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.410017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1289/2559] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:51 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:51.415465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.436241 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71cc1-9a8d-441a-920e-a66e00838c88 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.502932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.503935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.504592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.505099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.506082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.508185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.623758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1271/2560] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:51 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:51.630684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.642088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696194b0-c5f6-4f55-a0f9-64f3864e988a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.647033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.649770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.649770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.649770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.649770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.650492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.662514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1290/2561] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:51.667713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.679478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429abcd-ff8e-4295-bb7b-18a747b363f8 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.685225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.685864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.686140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.686445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.687261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.688933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00839-07c4-4050-b06c-96512883b07d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:51.700781 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1272/2562] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:53:51.705190 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:51.716573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7840f5-e96f-4c1a-adbf-caa56ae37940 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:51.721545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:51.722260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:51.722538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:51.722808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] PATH_INFO: `/v3/projects/9eae001b4add40f8a42449589a86f9d8/users/9eb38faf5eed4132b5a845823f5d736b/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:51.740415 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eae001b4add40f8a42449589a86f9d8, user_id=9eb38faf5eed4132b5a845823f5d736b, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:51.743806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:52.062440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1291/2563] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:51 2022] PUT /identity/v3/projects/9eae001b4add40f8a42449589a86f9d8/users/9eb38faf5eed4132b5a845823f5d736b/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:52.067436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680850f-84f7-44d1-825f-f4f4db222a1c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.067914 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680850f-84f7-44d1-825f-f4f4db222a1c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.068015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680850f-84f7-44d1-825f-f4f4db222a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.087019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2680850f-84f7-44d1-825f-f4f4db222a1c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:52.088215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2680850f-84f7-44d1-825f-f4f4db222a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:52.128397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:52.146674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1273/2564] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:52.156793 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:52.158625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:52.221169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1c2fd-7f42-4741-9168-b2b1a24d5a96 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:52.224949 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:52.225559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:52.225837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:52.226145 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:52.239296 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:52.243156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:52.256599 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1292/2565] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:53.856602 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:53.857494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:53.857797 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:53.922108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] MFA Rules not processed for user `9eb38faf5eed4132b5a845823f5d736b`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:53.924498 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:54.076292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1274/2566] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:54.081079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.094122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143799-bf63-46ff-980a-22af85fb0d48 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.108512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.109135 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.109412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.109695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.110413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.112553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.220666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1293/2567] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:53:54 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:53:54.222257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.235548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b6e12-082d-419c-abbc-01dc5b1b0655 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.305441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.306569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.306958 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.307336 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.308855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.310977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.415125 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1275/2568] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:53:54 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:53:54.416816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.428079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163fb1d-4939-44e4-8805-9cb1665d7042 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.433787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.434544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.435003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.435387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.436122 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.437837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.450939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1294/2569] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:54.454989 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.465818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496dcd-bc16-42ee-a1db-e605c5864355 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.470761 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.471488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.471829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.472187 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] PATH_INFO: `/v3/projects/fd61922868b5424d9139a584b3a3f2cf/users/22fc9dbecd8a4d76b75f19e03f9d8a40/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.490760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd61922868b5424d9139a584b3a3f2cf, user_id=22fc9dbecd8a4d76b75f19e03f9d8a40, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.494070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.585655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1276/2570] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:54 2022] PUT /identity/v3/projects/fd61922868b5424d9139a584b3a3f2cf/users/22fc9dbecd8a4d76b75f19e03f9d8a40/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:53:54.588474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.599753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2b929-7ba0-4bd6-ab24-1537769fed10 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.667313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.668086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.668361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.668781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.669553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.671266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f07f2-01af-4bca-ab9f-0a5a141de7f0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.686222 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1295/2571] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:53:54.687842 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:54.698395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1841485-94d0-4c98-b4d2-15b60210ba24 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:54.703406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:54.704063 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:54.704337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:54.704611 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] PATH_INFO: `/v3/projects/fd61922868b5424d9139a584b3a3f2cf/users/22fc9dbecd8a4d76b75f19e03f9d8a40/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:54.706653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd61922868b5424d9139a584b3a3f2cf, user_id=22fc9dbecd8a4d76b75f19e03f9d8a40, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:54.709308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f05e0-2c39-48f9-abf0-936956509de1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:54.721301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1277/2572] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:53:54 2022] PUT /identity/v3/projects/fd61922868b5424d9139a584b3a3f2cf/users/22fc9dbecd8a4d76b75f19e03f9d8a40/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:56.356853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:56.357395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:56.357395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:56.377629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:56.387930 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] MFA Rules not processed for user `22fc9dbecd8a4d76b75f19e03f9d8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:56.389148 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:56.465715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1296/2573] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:57.303462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.303952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.304077 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.325222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:53:57.326504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.347547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:57.381856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1278/2574] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:53:57.394046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.395486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.472923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4992ef-3610-4395-81ba-4582354e2677 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.478892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.479496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.479770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.480042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.488385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.489983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.498030 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1297/2575] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 12:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 12:53:57.680051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.680051 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.751778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722a43-4e60-469a-afeb-8c4b810c250e None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.758340 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.758932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.759213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.759478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.761182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:57.772927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.775140 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:57.785363 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1279/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:53:57.914479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:57.988348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71915562-75f8-46cf-b2e5-232aba218f7a service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:57.993569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:57.994219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:57.994504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:57.994771 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] PATH_INFO: `/v3/users/9eb38faf5eed4132b5a845823f5d736b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:57.995879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb38faf5eed4132b5a845823f5d736b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:57.997780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:58.080213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:58.172659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb38faf5eed4132b5a845823f5d736b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.184917 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb38faf5eed4132b5a845823f5d736b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.272014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb38faf5eed4132b5a845823f5d736b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.279845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb38faf5eed4132b5a845823f5d736b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.279845 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb38faf5eed4132b5a845823f5d736b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.287031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1298/2577] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:57 2022] DELETE /identity/v3/users/9eb38faf5eed4132b5a845823f5d736b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:58.589566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:58.600306 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c37b34-a747-4e9b-be2e-d3eec933ec9e service placement] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:58.660637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:58.661287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:58.661559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:58.661827 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] PATH_INFO: `/v3/projects/9eae001b4add40f8a42449589a86f9d8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:58.662963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eae001b4add40f8a42449589a86f9d8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:58.665421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:58.798746 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eae001b4add40f8a42449589a86f9d8', 'request_id': 'req-c5c802a8-0a00-4f5d-9056-524de2aab513'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.805343 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eae001b4add40f8a42449589a86f9d8', 'request_id': 'req-c5c802a8-0a00-4f5d-9056-524de2aab513'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.913442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eae001b4add40f8a42449589a86f9d8', 'request_id': 'req-c5c802a8-0a00-4f5d-9056-524de2aab513'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.915768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:53:58.924391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] The token cache is being invalidate because project 9eae001b4add40f8a42449589a86f9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:53:58.924674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.925436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:58.926911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1280/2578] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:58 2022] DELETE /identity/v3/projects/9eae001b4add40f8a42449589a86f9d8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:58.931430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:58.932843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:58.946507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8025e-bd6b-440f-bf31-7f25888a0275 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.003472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.004105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.004385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.004655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] PATH_INFO: `/v3/users/22fc9dbecd8a4d76b75f19e03f9d8a40` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.005780 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fc9dbecd8a4d76b75f19e03f9d8a40)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.008353 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.327337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fc9dbecd8a4d76b75f19e03f9d8a40'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.344674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fc9dbecd8a4d76b75f19e03f9d8a40'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.438880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fc9dbecd8a4d76b75f19e03f9d8a40'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.439520 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fc9dbecd8a4d76b75f19e03f9d8a40'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.440129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b6c69e1-6eed-4104-a19e-72f8a8378afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fc9dbecd8a4d76b75f19e03f9d8a40'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.453280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1299/2579] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:53:58 2022] DELETE /identity/v3/users/22fc9dbecd8a4d76b75f19e03f9d8a40 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:53:59.720741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:53:59.722385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:53:59.738309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c802a8-0a00-4f5d-9056-524de2aab513 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:53:59.796027 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:53:59.796650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:53:59.796952 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:53:59.797222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] PATH_INFO: `/v3/projects/fd61922868b5424d9139a584b3a3f2cf` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:53:59.798353 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd61922868b5424d9139a584b3a3f2cf)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:53:59.800243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:53:59.915972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd61922868b5424d9139a584b3a3f2cf', 'request_id': 'req-081f4a00-ec80-49e3-bd24-4a17e74b3732'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:53:59.923017 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd61922868b5424d9139a584b3a3f2cf', 'request_id': 'req-081f4a00-ec80-49e3-bd24-4a17e74b3732'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.016733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd61922868b5424d9139a584b3a3f2cf', 'request_id': 'req-081f4a00-ec80-49e3-bd24-4a17e74b3732'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.028121 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] The token cache is being invalidate because project fd61922868b5424d9139a584b3a3f2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:00.028729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.029620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-081f4a00-ec80-49e3-bd24-4a17e74b3732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:00.031314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1281/2580] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:53:59 2022] DELETE /identity/v3/projects/fd61922868b5424d9139a584b3a3f2cf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:00.036184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.036669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.036786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.056928 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:00.058117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.074563 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:00.116760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1300/2581] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:00.125230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.125514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.125788 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.145000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:00.146367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.155013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1282/2582] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:00.159244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.169618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9d91-bdf6-4d5a-9b0a-fc5ffce47e43 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.174729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.175321 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.175595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.175861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.176490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:00.176788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.178385 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.190137 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1301/2583] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:00.194417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.204669 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ca03-6119-4d50-96fa-c18e038399f0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.209452 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.210047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.210355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.210659 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.211305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.213238 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.314845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1283/2584] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:00.319194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.330526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8882472-3029-479c-a194-ffb361326e86 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.386540 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.387142 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.387417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.387690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.388312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.390332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.492921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1302/2585] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:00.494102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.505014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47066-4b40-4322-b2bd-ed3bf9d774ab admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.510296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.510895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.511173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.511445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.512111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.513703 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.524034 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1284/2586] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:00.528090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.538146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8bdeb3-9061-4526-ad9b-e0f937b7114e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.544113 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.544652 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.544933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.545200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.545834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.547445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d093d8-c4f7-4e97-bb41-b9b03b6167f0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.558764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1303/2587] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:00.563054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.573489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e9ef-1a22-4052-be85-fe1773303b18 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.578022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.578796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.579028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.579300 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] PATH_INFO: `/v3/projects/51aac60213fd4c5f838f8c8d45d6381f/users/8225668cd5a347e89943bef7ea40ad1c/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.594144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51aac60213fd4c5f838f8c8d45d6381f, user_id=8225668cd5a347e89943bef7ea40ad1c, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.596872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:00.708104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1285/2588] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:00 2022] PUT /identity/v3/projects/51aac60213fd4c5f838f8c8d45d6381f/users/8225668cd5a347e89943bef7ea40ad1c/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:00.718710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.718996 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.719390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.752792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] MFA Rules not processed for user `8225668cd5a347e89943bef7ea40ad1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:00.754014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:00.820508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1304/2589] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:00.825176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:00.845780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:00.891018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214473-3479-46f5-a35e-4135863739bf admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:00.895928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:00.896535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:00.896814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:00.897088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:00.897720 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:00.900191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.030000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1286/2590] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:01.034213 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.046130 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5513f-3d32-411c-936f-11942f70eb12 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.066999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.100379 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.102873 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.118090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.118739 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.119019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.119292 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.119915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.121824 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.173810 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10de76-cf40-479c-b0cb-fb31f94811ef admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.178628 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.179261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.180050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.180324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] PATH_INFO: `/v3/users/5c8054538c6f4e8ebb890075aa1b7283` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.181506 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8054538c6f4e8ebb890075aa1b7283)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.183528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.216408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1305/2591] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:01.220457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.231096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e603f-0788-4fe0-9766-50e9d488cf6c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.235854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.236444 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.236724 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.236994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.237623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.239233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.249537 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1306/2592] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:01.253616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.263958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b1714-811f-408a-919d-4694eefbd4fc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.268889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.274871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.274871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.274871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] PATH_INFO: `/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2/users/9935f21f8c3c46af9915e3b73cce537d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.284952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=16087f087f1b4daf9eb3d02d05db6bb2, user_id=9935f21f8c3c46af9915e3b73cce537d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.287680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.411371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1307/2593] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:01 2022] PUT /identity/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2/users/9935f21f8c3c46af9915e3b73cce537d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:01.415751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.452668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8054538c6f4e8ebb890075aa1b7283'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.453313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8054538c6f4e8ebb890075aa1b7283'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.465931 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8054538c6f4e8ebb890075aa1b7283'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.476653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33bb2a-e78c-4935-9f0f-6e4607f0bdbd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.481767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.482400 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.482684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.482958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.483591 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.485172 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.495317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1308/2594] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:01.499413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.501022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.513217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643277-dce3-49c5-894f-a120e953c528 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.517881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.518528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.518811 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.519088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] PATH_INFO: `/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2/users/9935f21f8c3c46af9915e3b73cce537d/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.520982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16087f087f1b4daf9eb3d02d05db6bb2, user_id=9935f21f8c3c46af9915e3b73cce537d, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.523639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c7516-8d51-4678-bf0e-1de657449fa4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.533374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1309/2595] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:01 2022] PUT /identity/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2/users/9935f21f8c3c46af9915e3b73cce537d/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:01.544815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.545103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.545379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.572784 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] MFA Rules not processed for user `9935f21f8c3c46af9915e3b73cce537d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:01.574012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.576280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8054538c6f4e8ebb890075aa1b7283'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.576969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8054538c6f4e8ebb890075aa1b7283'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:01.590293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1287/2596] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:01 2022] DELETE /identity/v3/users/5c8054538c6f4e8ebb890075aa1b7283 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:01.621808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.646648 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1310/2597] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:01.658559 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.659953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.687437 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:01.718580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb681e-aee4-4ceb-b5bb-82550c7d0506 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:01.722272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:01.722889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:01.723176 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:01.723710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:01.787655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:01.789673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:01.799163 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1288/2598] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:01.915662 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:01.917201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:01.993468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185086fa-3b64-409e-aa20-09b8e6ae7310 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.048136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.048829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.049024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.049294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] PATH_INFO: `/v3/projects/0fa7ab184f2d475899be14a15bf9cb42` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.050445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa7ab184f2d475899be14a15bf9cb42)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.052346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.081754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.090845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1ce90-1a39-42a8-b452-9659f30cc71c service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.094342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.094963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.095239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.095504 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.097214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.154819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.156335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1e385-91ec-4405-8703-bace0920b657 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.165856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1289/2599] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:02.170628 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa7ab184f2d475899be14a15bf9cb42', 'request_id': 'req-e7edff75-5b36-40ab-82ea-85164ff21351'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:02.273451 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa7ab184f2d475899be14a15bf9cb42', 'request_id': 'req-e7edff75-5b36-40ab-82ea-85164ff21351'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:02.280258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa7ab184f2d475899be14a15bf9cb42', 'request_id': 'req-e7edff75-5b36-40ab-82ea-85164ff21351'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:02.291669 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] The token cache is being invalidate because project 0fa7ab184f2d475899be14a15bf9cb42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:02.291958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:02.292601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e7edff75-5b36-40ab-82ea-85164ff21351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:02.294123 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1311/2600] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:01 2022] DELETE /identity/v3/projects/0fa7ab184f2d475899be14a15bf9cb42 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:02.299039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.299330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.299617 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.319874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:02.321302 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.380519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1290/2601] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:02.448715 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.448918 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.449196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.469156 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:02.470378 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:02.479118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1312/2602] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:02.483526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.493482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144db758-8f27-4af5-afa6-975158c988f5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.498263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.498858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.499144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.499414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.500049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:02.500350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.501990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.508826 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:02.513884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1291/2603] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:54:02.518304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.528127 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282ea30-4e3c-4df8-b349-09985ae22b5e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.532907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.533496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.533773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.534042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.534700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.536590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.546761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:02.635102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1313/2604] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:02.639153 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.649820 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f84f39-192f-4987-a232-e9743a509864 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.711160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.711718 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.711980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.712233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.712909 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.714887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.816944 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1292/2605] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:02 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:02.821161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.831542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9c7f-5eaa-429e-ac2f-8472b0e8eec5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.836675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.837276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.837610 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.837910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.838646 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.840284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.850097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1314/2606] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:02.854941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.865080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40cbe9-3edf-45f7-9b37-0187da1c1c9e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.870493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.871096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.871370 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.871641 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.872381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.873859 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e702b-5a05-47f1-9ff2-d96ea3119f72 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:02.884044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1293/2607] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:02.889161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:02.899110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609a0d-27cd-4062-9c24-ecdb7668e592 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:02.903698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:02.904338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:02.904629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:02.905109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] PATH_INFO: `/v3/projects/b35cdedf5eea4b89b9b6c97d4778d5de/users/3d4033a7a1c94da9a40f3a00be077b9a/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:02.920773 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35cdedf5eea4b89b9b6c97d4778d5de, user_id=3d4033a7a1c94da9a40f3a00be077b9a, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:02.923534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:03.002843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1315/2608] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:02 2022] PUT /identity/v3/projects/b35cdedf5eea4b89b9b6c97d4778d5de/users/3d4033a7a1c94da9a40f3a00be077b9a/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:03.015493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:03.015974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:03.016570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:03.051022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] MFA Rules not processed for user `3d4033a7a1c94da9a40f3a00be077b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:03.052284 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:03.115529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1294/2609] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:03.127776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:03.129552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:03.190786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45518305-c468-4b7e-8cf7-69c3d725be68 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:03.194676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:03.196658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:03.196658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:03.196658 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:03.204852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:03.206317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea54ba-3268-4357-8bd6-23014dccca39 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:03.215476 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1316/2610] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:05.740150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:05.742154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:05.810677 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffef14-a987-43a1-86be-ce372d3e11ef None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:05.815304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:05.815932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:05.816211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:05.816527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] PATH_INFO: `/v3/users/8225668cd5a347e89943bef7ea40ad1c` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:05.817689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8225668cd5a347e89943bef7ea40ad1c)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:05.819626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:05.826226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:06.008916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8225668cd5a347e89943bef7ea40ad1c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.009492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8225668cd5a347e89943bef7ea40ad1c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.022325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8225668cd5a347e89943bef7ea40ad1c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.124622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8225668cd5a347e89943bef7ea40ad1c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.125235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8225668cd5a347e89943bef7ea40ad1c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.138586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1295/2611] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:05 2022] DELETE /identity/v3/users/8225668cd5a347e89943bef7ea40ad1c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:06.144304 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:06.144803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:06.144904 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:06.164449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:06.165644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:06.227170 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1317/2612] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:06.237096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:06.238536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:06.297650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eec47f-1c4a-47f7-8ef4-b82961bda1b7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:06.301443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:06.302040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:06.302357 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:06.302630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:06.311934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:06.313443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:06.324597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1296/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:06.783395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:06.784937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:06.800061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982070fe-30ee-40d9-b28d-ab943d19ff45 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:06.804994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:06.805677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:06.806071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:06.806398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] PATH_INFO: `/v3/projects/51aac60213fd4c5f838f8c8d45d6381f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:06.807525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51aac60213fd4c5f838f8c8d45d6381f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:06.809505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:06.932947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51aac60213fd4c5f838f8c8d45d6381f', 'request_id': 'req-10423e72-6353-43f0-8935-1ce647d6b45b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:06.935786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:07.038883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51aac60213fd4c5f838f8c8d45d6381f', 'request_id': 'req-10423e72-6353-43f0-8935-1ce647d6b45b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.046117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51aac60213fd4c5f838f8c8d45d6381f', 'request_id': 'req-10423e72-6353-43f0-8935-1ce647d6b45b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.057958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] The token cache is being invalidate because project 51aac60213fd4c5f838f8c8d45d6381f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:07.058167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.058901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.060506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1318/2614] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:06 2022] DELETE /identity/v3/projects/51aac60213fd4c5f838f8c8d45d6381f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:07.064660 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:07.074991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7c8b-cfc7-42c9-8f27-a1e8a3d93115 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:07.134509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:07.135141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:07.135423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:07.135682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] PATH_INFO: `/v3/users/9935f21f8c3c46af9915e3b73cce537d` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:07.136805 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9935f21f8c3c46af9915e3b73cce537d)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:07.138724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:07.308668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:07.322120 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9935f21f8c3c46af9915e3b73cce537d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.322811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9935f21f8c3c46af9915e3b73cce537d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.334574 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9935f21f8c3c46af9915e3b73cce537d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.415475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9935f21f8c3c46af9915e3b73cce537d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.416110 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ad40615-e4bf-4bbd-bf3e-6b7384f7f3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9935f21f8c3c46af9915e3b73cce537d'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:07.429002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1297/2615] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:07 2022] DELETE /identity/v3/users/9935f21f8c3c46af9915e3b73cce537d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:07.881977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:07.888655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:07.903556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10423e72-6353-43f0-8935-1ce647d6b45b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:07.963438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:07.964103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:07.964379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:07.964651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] PATH_INFO: `/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:07.965765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16087f087f1b4daf9eb3d02d05db6bb2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:07.967700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.127602 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16087f087f1b4daf9eb3d02d05db6bb2', 'request_id': 'req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.193343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16087f087f1b4daf9eb3d02d05db6bb2', 'request_id': 'req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.200240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16087f087f1b4daf9eb3d02d05db6bb2', 'request_id': 'req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.211379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] The token cache is being invalidate because project 16087f087f1b4daf9eb3d02d05db6bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:08.211672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.212325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f91e8eee-0e12-4f8f-ba3d-0acdbdeae036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:08.213813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1319/2616] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:07 2022] DELETE /identity/v3/projects/16087f087f1b4daf9eb3d02d05db6bb2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:08.218699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.219173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.219270 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.239382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:08.240631 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.308933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1298/2617] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:08.316663 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.316943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.317211 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.337788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:08.339018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.347202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1320/2618] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:08.352083 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.362264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e51e7-0b45-4162-babd-2c300f038e82 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.366816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.367917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.368190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.368458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.369093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:08.369389 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.371020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.382487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1299/2619] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:08.386689 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.396175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549d78-cb33-496f-a3a5-87cf16a42a68 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.401379 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.401972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.402303 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.402573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.403193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.405051 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.479518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1321/2620] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:08.483569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.494563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508635-471e-4843-8c25-7f21ac682438 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.550723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.551324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.551599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.551868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.552489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.554900 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.680875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1300/2621] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:08.685943 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.697929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acab38-c976-4670-9e70-3a76fd636aaf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.702606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.703210 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.703485 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.703751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.704411 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.705990 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.716372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1322/2622] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:08.720418 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.730571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc5b4-3f3a-4648-84d2-26db6e4fb076 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.735128 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.735713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.735991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.736252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.736877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.738483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d34f3-7bde-48f5-932a-e591953115f4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.749707 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1301/2623] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:08.754055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.764805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ae91c-a80a-4141-985a-a37bd11497b2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:08.769297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:08.769936 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.770232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.770504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] PATH_INFO: `/v3/projects/d7b3dbcfa3c74debb11ea5e4541012cf/users/2ebb7b44d7cc4c5a8f96bbb36f36d812/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.784454 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b3dbcfa3c74debb11ea5e4541012cf, user_id=2ebb7b44d7cc4c5a8f96bbb36f36d812, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:08.787104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:08.873876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1323/2624] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:08 2022] PUT /identity/v3/projects/d7b3dbcfa3c74debb11ea5e4541012cf/users/2ebb7b44d7cc4c5a8f96bbb36f36d812/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:08.886262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e599-e1f4-4442-af65-77187cde942a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:08.886542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e599-e1f4-4442-af65-77187cde942a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:08.886840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666e599-e1f4-4442-af65-77187cde942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:08.911324 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:08.914723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1666e599-e1f4-4442-af65-77187cde942a None None] MFA Rules not processed for user `2ebb7b44d7cc4c5a8f96bbb36f36d812`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:08.915941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1666e599-e1f4-4442-af65-77187cde942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:08.982296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1302/2625] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:08.986471 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:08.995406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:09.050434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45801445-d1a9-4e0d-9ca6-269a52c08886 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.055680 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.056278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.056559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.056830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.057438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.059369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.235347 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1324/2626] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:08 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:09.239330 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666e599-e1f4-4442-af65-77187cde942a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.250556 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666e599-e1f4-4442-af65-77187cde942a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.311796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.312407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.312740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.313007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.313734 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.315551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.498481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1303/2627] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/users => generated 298 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:09.502640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.513473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c257607-6fa4-4cfd-89ae-307398b2d56b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.518070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.518703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.518977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.519244 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.519866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.521443 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.531910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1325/2628] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:09.536141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.546589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5be59-8e41-441e-86bd-b5102777f4cc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.551184 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.551852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.552099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.552368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] PATH_INFO: `/v3/projects/a1497e68cfbf4112a1f314be6d3af50d/users/9a031fb074a244bc9862c93c2c2a0176/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.567147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1497e68cfbf4112a1f314be6d3af50d, user_id=9a031fb074a244bc9862c93c2c2a0176, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.569793 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.645182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1304/2629] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:09 2022] PUT /identity/v3/projects/a1497e68cfbf4112a1f314be6d3af50d/users/9a031fb074a244bc9862c93c2c2a0176/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:09.650071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.660795 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccfad5-0cc2-4063-a7b0-3d280cb44aa7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.725448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.726103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.726408 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.726679 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.727299 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.729191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaba35-b5ee-4025-a1cb-38f99b7373a6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.738644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1326/2630] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:09.742918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.753901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa4a15-615d-4e64-82d2-e5fa1360051f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.759301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.760014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.760294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.760568 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] PATH_INFO: `/v3/projects/a1497e68cfbf4112a1f314be6d3af50d/users/9a031fb074a244bc9862c93c2c2a0176/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.762524 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1497e68cfbf4112a1f314be6d3af50d, user_id=9a031fb074a244bc9862c93c2c2a0176, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.765196 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.776355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1305/2631] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:09 2022] PUT /identity/v3/projects/a1497e68cfbf4112a1f314be6d3af50d/users/9a031fb074a244bc9862c93c2c2a0176/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:09.786575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.786884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.787158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.816141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] MFA Rules not processed for user `9a031fb074a244bc9862c93c2c2a0176`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:09.817370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.886088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1327/2632] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:09.896791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:09.898530 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:09.957197 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93c24d-85ba-4fb6-ba12-bb93ce786060 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:09.961397 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:09.962001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:09.962311 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:09.962583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:09.971516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:09.972975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:09.977520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:09.983816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1306/2633] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:10.086447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:10.091042 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:10.096256 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb51e3-41ab-4cc7-9ba5-f7d3e85dc611 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:10.099875 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:10.101040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:10.101040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:10.101040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:10.159741 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:10.161205 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b73bf-8f7d-4b72-899c-0c0b51cb8c62 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:10.171022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1328/2634] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:13.289150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:13.354903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8a88-dd73-4534-8976-4bbbf2552040 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:13.359497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:13.360116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:13.360388 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:13.360652 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] PATH_INFO: `/v3/users/2ebb7b44d7cc4c5a8f96bbb36f36d812` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:13.361755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebb7b44d7cc4c5a8f96bbb36f36d812)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:13.363680 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:13.687269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebb7b44d7cc4c5a8f96bbb36f36d812'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:13.687969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebb7b44d7cc4c5a8f96bbb36f36d812'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:13.703275 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebb7b44d7cc4c5a8f96bbb36f36d812'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:13.793425 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebb7b44d7cc4c5a8f96bbb36f36d812'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:13.794037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebb7b44d7cc4c5a8f96bbb36f36d812'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:13.810009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1307/2635] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:13 2022] DELETE /identity/v3/users/2ebb7b44d7cc4c5a8f96bbb36f36d812 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:13.820248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:13.820248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:13.820248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:13.839047 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:13.840596 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:13.901562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1329/2636] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:13.911298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:13.912650 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:13.972837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580fb6-f070-45b9-8b93-d5b55c360979 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:13.976433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:13.977036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:13.977309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:13.977573 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:13.986705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:13.988129 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:13.998230 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1308/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:14.703946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:14.710505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:14.719403 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21185976-4c70-4bbb-b57c-535812b8aa76 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:14.724184 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:14.724823 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:14.725102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:14.725371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] PATH_INFO: `/v3/projects/d7b3dbcfa3c74debb11ea5e4541012cf` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:14.726542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b3dbcfa3c74debb11ea5e4541012cf)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:14.728860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:14.869159 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b3dbcfa3c74debb11ea5e4541012cf', 'request_id': 'req-7a6635d9-a721-4a02-bead-4ef03e399b7c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:14.935796 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b3dbcfa3c74debb11ea5e4541012cf', 'request_id': 'req-7a6635d9-a721-4a02-bead-4ef03e399b7c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:14.942635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b3dbcfa3c74debb11ea5e4541012cf', 'request_id': 'req-7a6635d9-a721-4a02-bead-4ef03e399b7c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:14.953452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] The token cache is being invalidate because project d7b3dbcfa3c74debb11ea5e4541012cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:14.953743 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:14.954433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:14.955945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1330/2638] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:14 2022] DELETE /identity/v3/projects/d7b3dbcfa3c74debb11ea5e4541012cf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:14.959923 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:14.969599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7a578-6c5b-493f-a85d-961175a4aff4 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:14.986444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:15.026070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:15.026729 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:15.027005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:15.027276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] PATH_INFO: `/v3/users/9a031fb074a244bc9862c93c2c2a0176` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:15.028390 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a031fb074a244bc9862c93c2c2a0176)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:15.030329 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:15.210591 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a031fb074a244bc9862c93c2c2a0176'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.211242 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a031fb074a244bc9862c93c2c2a0176'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.223260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a031fb074a244bc9862c93c2c2a0176'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.294662 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a031fb074a244bc9862c93c2c2a0176'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.295285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a93e2b7b-9833-45fd-a28d-5dfb6ddd7cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a031fb074a244bc9862c93c2c2a0176'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:15.308871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1309/2639] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:14 2022] DELETE /identity/v3/users/9a031fb074a244bc9862c93c2c2a0176 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:15.828820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:15.830273 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:15.843542 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6635d9-a721-4a02-bead-4ef03e399b7c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:15.865420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:15.905541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:15.906216 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:15.906573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:15.907066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] PATH_INFO: `/v3/projects/a1497e68cfbf4112a1f314be6d3af50d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:15.908395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1497e68cfbf4112a1f314be6d3af50d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:15.910344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.066911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1497e68cfbf4112a1f314be6d3af50d', 'request_id': 'req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.141876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1497e68cfbf4112a1f314be6d3af50d', 'request_id': 'req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.148756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1497e68cfbf4112a1f314be6d3af50d', 'request_id': 'req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.159091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] The token cache is being invalidate because project a1497e68cfbf4112a1f314be6d3af50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:16.159374 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.160109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bc0dc66f-ee12-4bc4-bac6-47415d474d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:16.161690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1331/2640] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:15 2022] DELETE /identity/v3/projects/a1497e68cfbf4112a1f314be6d3af50d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:16.167403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.167871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.167967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.187587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:16.188790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:16.247316 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1310/2641] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:16.255054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.255401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.255675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.275711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:16.276885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:16.284732 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1332/2642] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:16.289495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.299410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bbf46-449e-4618-9bec-5e3e49582ad4 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.304024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.305108 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.305385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.305657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.306325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:16.306625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.308215 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.319476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1311/2643] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:16.323885 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.333049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e418da-098f-462c-99ed-7d543f95b9f7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.337882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.338513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.338790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.339059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.339706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.341604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.445861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1333/2644] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:16.450423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.460493 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77508-743b-4728-a6b8-92cc6ddb9552 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.486071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:16.531436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.532031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.532304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.532570 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.533185 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.535115 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.660146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1312/2645] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/users => generated 304 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:16.665021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.675336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021a165-7118-4f81-9fcd-76eace5f7d2c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.680861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.681402 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.681684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.682248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.682618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.684243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.696621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1334/2646] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:16.700598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.711582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b890df7-787a-47e7-9c32-0765fff86eea admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.716835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.717427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.717822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.718170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.718877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.720657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad46f9-b0e6-4d8d-b5f1-5fdcda811b5a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.731018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1313/2647] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:16.735061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:16.745401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb30b1-17a1-46b5-954f-bc9cd0549b5d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:16.749889 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:16.750560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.750839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.751103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] PATH_INFO: `/v3/projects/778e97b9fe69423eb6e5f0bd4f4a1055/users/07c4d075c9a642cd9b7400c89f26c6bb/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.765203 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778e97b9fe69423eb6e5f0bd4f4a1055, user_id=07c4d075c9a642cd9b7400c89f26c6bb, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:16.767882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:16.838235 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1335/2648] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:16 2022] PUT /identity/v3/projects/778e97b9fe69423eb6e5f0bd4f4a1055/users/07c4d075c9a642cd9b7400c89f26c6bb/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:16.849481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:16.849837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:16.850141 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:16.879012 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] MFA Rules not processed for user `07c4d075c9a642cd9b7400c89f26c6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:16.880283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:16.943576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1314/2649] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:16.948694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.000604 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:17.012370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f409-0976-4561-ac86-857061ddf760 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.017086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.017687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.017965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.018265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.018925 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.020806 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.176567 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1336/2650] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:16 2022] POST /identity/v3/projects => generated 407 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:17.180606 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.191354 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eee19-5804-4f54-abb5-9c87cc4407d5 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.247015 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.247548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.247829 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.248104 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.248725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.250673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.342748 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1315/2651] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:17 2022] POST /identity/v3/users => generated 310 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:17.346922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.357587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8122a-d215-4a2f-9bbe-20cb5ec23f91 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.362417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.363004 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.363279 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.363548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.364175 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.365758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.375510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1337/2652] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:17.382941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.392972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2557f-d2a7-459a-b29c-ae4556169731 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.397674 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.398912 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.399192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.399486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] PATH_INFO: `/v3/projects/4666bd5ed3a345e6a6417490a8caa77f/users/6e4572293ecf452eb8c016087e5d8099/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.413862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4666bd5ed3a345e6a6417490a8caa77f, user_id=6e4572293ecf452eb8c016087e5d8099, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.416547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.497377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:17.501939 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1316/2653] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:17 2022] PUT /identity/v3/projects/4666bd5ed3a345e6a6417490a8caa77f/users/6e4572293ecf452eb8c016087e5d8099/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:17.505926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.515967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e7b6b-b499-4095-8871-29c12ffa9d41 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.573416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.574019 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.574335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.574611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.575239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.576808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e29a11-ed71-49ec-88f3-2e4fcde38415 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.586462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1338/2654] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:17.590584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.600587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1358ff-5769-4ab4-8393-5a413ca54500 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.605412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.606049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.606355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.606627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] PATH_INFO: `/v3/projects/4666bd5ed3a345e6a6417490a8caa77f/users/6e4572293ecf452eb8c016087e5d8099/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.608519 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4666bd5ed3a345e6a6417490a8caa77f, user_id=6e4572293ecf452eb8c016087e5d8099, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.611157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.621516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1317/2655] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:17 2022] PUT /identity/v3/projects/4666bd5ed3a345e6a6417490a8caa77f/users/6e4572293ecf452eb8c016087e5d8099/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:17.631621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.631911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.632783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.660058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] MFA Rules not processed for user `6e4572293ecf452eb8c016087e5d8099`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:17.661263 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:17.727683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1339/2656] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:17.738768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:17.745313 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:17.799772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29644803-bd6a-4261-8942-3bea3c2bf93a admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:17.803382 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:17.804020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:17.804789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:17.805058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:17.813789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:17.815236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:17.824497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1318/2657] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:18.225914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:18.236049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d33f19-07a7-438f-83ef-28d1e93fd29e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:18.239630 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:18.240219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:18.240492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:18.240760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:18.285200 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:18.297621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:18.299219 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493ee6a-88ba-4341-8959-5f3b83a93b28 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:18.308632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1340/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:27.820384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:28.375274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:32.224661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:32.286362 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832e08-1755-4703-86db-d3ddd84202e9 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:32.291657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:32.292610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.293028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.293415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] PATH_INFO: `/v3/users/07c4d075c9a642cd9b7400c89f26c6bb` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.295087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c4d075c9a642cd9b7400c89f26c6bb)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:32.298213 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:32.491613 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c4d075c9a642cd9b7400c89f26c6bb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:32.492181 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c4d075c9a642cd9b7400c89f26c6bb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:32.503834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c4d075c9a642cd9b7400c89f26c6bb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:32.683963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c4d075c9a642cd9b7400c89f26c6bb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:32.684586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c4d075c9a642cd9b7400c89f26c6bb'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:32.697902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1319/2659] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:32 2022] DELETE /identity/v3/users/07c4d075c9a642cd9b7400c89f26c6bb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:32.702461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.702952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.703075 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.721851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:32.723096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:32.787461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1341/2660] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:32.795080 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:32.799741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:32.855633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14ab07-aee2-4c04-9249-1f83f059e483 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:32.859653 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:32.873925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:32.873925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:32.873925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:32.873925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:32.873925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:32.882082 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1320/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:33.394396 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:33.396057 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:33.412729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f7a3-fd43-4616-bb21-b14ff6d516a6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:33.417887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:33.418562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:33.418911 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:33.419090 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] PATH_INFO: `/v3/projects/778e97b9fe69423eb6e5f0bd4f4a1055` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:33.420245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=778e97b9fe69423eb6e5f0bd4f4a1055)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:33.422157 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:33.553625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778e97b9fe69423eb6e5f0bd4f4a1055', 'request_id': 'req-3ab97a20-914c-4028-9ddb-8a9981065fbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.629830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778e97b9fe69423eb6e5f0bd4f4a1055', 'request_id': 'req-3ab97a20-914c-4028-9ddb-8a9981065fbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.636511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778e97b9fe69423eb6e5f0bd4f4a1055', 'request_id': 'req-3ab97a20-914c-4028-9ddb-8a9981065fbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.647600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] The token cache is being invalidate because project 778e97b9fe69423eb6e5f0bd4f4a1055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:33.647887 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.648558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.650167 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1342/2662] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:33 2022] DELETE /identity/v3/projects/778e97b9fe69423eb6e5f0bd4f4a1055 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:33.654731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:33.666858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b28c2-98cc-4eda-9745-5d1761c41d6d service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:33.686690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:33.724226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:33.724858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:33.725137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:33.725926 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] PATH_INFO: `/v3/users/6e4572293ecf452eb8c016087e5d8099` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:33.727092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4572293ecf452eb8c016087e5d8099)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:33.729286 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:33.915916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4572293ecf452eb8c016087e5d8099'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.916586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4572293ecf452eb8c016087e5d8099'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:33.928341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4572293ecf452eb8c016087e5d8099'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.004023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4572293ecf452eb8c016087e5d8099'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.004643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-307b02da-4cd6-419e-b748-fd0377ef0f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4572293ecf452eb8c016087e5d8099'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.019177 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1321/2663] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:33 2022] DELETE /identity/v3/users/6e4572293ecf452eb8c016087e5d8099 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:34.479308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:34.480931 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:34.494753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab97a20-914c-4028-9ddb-8a9981065fbb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:34.550972 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:34.551601 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:34.551878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:34.552150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] PATH_INFO: `/v3/projects/4666bd5ed3a345e6a6417490a8caa77f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:34.553264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4666bd5ed3a345e6a6417490a8caa77f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:34.555843 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:34.696373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:34.714131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4666bd5ed3a345e6a6417490a8caa77f', 'request_id': 'req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.804533 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4666bd5ed3a345e6a6417490a8caa77f', 'request_id': 'req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.811439 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4666bd5ed3a345e6a6417490a8caa77f', 'request_id': 'req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.822447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] The token cache is being invalidate because project 4666bd5ed3a345e6a6417490a8caa77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:34.822725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.823387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f4cbcc5f-e94c-4a6b-97ea-5201bda8c2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:34.824890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1343/2664] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:34 2022] DELETE /identity/v3/projects/4666bd5ed3a345e6a6417490a8caa77f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:34.829710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:34.830220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:34.830318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:34.849795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:34.851078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:34.913903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1322/2665] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:34.921772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:34.922055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:34.922368 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:34.942730 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:34.943942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:34.952545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1344/2666] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:34.957079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:34.967222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4c04f-67d9-4190-8e15-22651cded8f8 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:34.971874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:34.972470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:34.972749 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:34.973022 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:34.973664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:34.973963 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:34.975636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:34.987536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1323/2667] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:34.992866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.002097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7f85-6b2d-46f4-9fb5-a381a745c850 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.007546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.008132 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.008404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.008670 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.009305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.011257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.130414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1345/2668] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:34 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:35.134543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.144713 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9896ff2-88bf-4d4d-be2c-69bcb9fa319f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.170948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:35.202127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.202834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.203050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.203318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.203932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.205854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.295774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1324/2669] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:35 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:35.299933 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.311110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c053-3407-4876-90cf-e05e01f1a9a4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.315830 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.316438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.316698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.317001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.317627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.319274 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.329078 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1346/2670] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:35.333039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.343117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7d0f-661a-4c0d-a162-c1049ea18497 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.347683 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.348269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.348544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.348814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.349446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.351551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.361539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1325/2671] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:35.365535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.375880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224899a-c275-493c-9378-0cdeb4f05f62 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.380466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.381100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.381373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.381644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] PATH_INFO: `/v3/projects/ea9389de67a246e48b1e780f1428f57f/users/4569d3d90e3b4e669b1d96b540dc1ea6/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.405656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9389de67a246e48b1e780f1428f57f, user_id=4569d3d90e3b4e669b1d96b540dc1ea6, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.408508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8c14b-b728-4fb0-8fc8-e4b5d2ce921c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.422727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.422727 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.425930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02275-0213-41ab-8279-2fcd8d6b2650 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.430728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.431346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.431619 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.431889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] PATH_INFO: `/v3/users/3d4033a7a1c94da9a40f3a00be077b9a` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.433031 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4033a7a1c94da9a40f3a00be077b9a)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.434990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.542114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1347/2672] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:35 2022] PUT /identity/v3/projects/ea9389de67a246e48b1e780f1428f57f/users/4569d3d90e3b4e669b1d96b540dc1ea6/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:35.607600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.607882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.608164 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.635738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] MFA Rules not processed for user `4569d3d90e3b4e669b1d96b540dc1ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:35.636962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.665134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4033a7a1c94da9a40f3a00be077b9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:35.665824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4033a7a1c94da9a40f3a00be077b9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:35.677974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4033a7a1c94da9a40f3a00be077b9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:35.703880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1348/2673] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:35.737398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.738842 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.769281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4033a7a1c94da9a40f3a00be077b9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:35.769936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-7b88f978-426b-415c-917d-1a6e318da38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4033a7a1c94da9a40f3a00be077b9a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:35.782929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1326/2674] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:35 2022] DELETE /identity/v3/users/3d4033a7a1c94da9a40f3a00be077b9a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:35.783708 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:35.787116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.787403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.787675 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.798060 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dc9e0-a540-4f28-99dd-2068bdc58ac8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.807402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:35.808622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.847945 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.848616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.848900 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.849173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.868416 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1327/2675] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:35.878059 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.879459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.900799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:35.908546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.909987 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.919892 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1349/2676] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:35.936041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:35.941506 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:35.942760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d7682-d114-4508-8dd9-f5e323fc09df None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.946476 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.947081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.947356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.947627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.951114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32201af9-bbe9-4b21-aa73-2fbe5dcd8cd0 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:35.956214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:35.956768 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.956951 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:35.957086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:35.957358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] PATH_INFO: `/v3/users/4569d3d90e3b4e669b1d96b540dc1ea6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:35.958214 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471110d-e78a-4beb-a82e-1874c85d4ad2 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.958608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4569d3d90e3b4e669b1d96b540dc1ea6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:35.960430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:35.969515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1328/2677] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:36.220557 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4569d3d90e3b4e669b1d96b540dc1ea6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.233964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4569d3d90e3b4e669b1d96b540dc1ea6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.341027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4569d3d90e3b4e669b1d96b540dc1ea6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.341650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4569d3d90e3b4e669b1d96b540dc1ea6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.342294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4569d3d90e3b4e669b1d96b540dc1ea6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.355371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1350/2678] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:54:35 2022] DELETE /identity/v3/users/4569d3d90e3b4e669b1d96b540dc1ea6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:36.359814 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.360098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.360371 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.379467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:36.380682 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:36.435198 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:36.436672 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:36.438408 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1329/2679] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:36.451143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94857d1-7466-4c6b-9d16-791838581b9e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:36.455902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:36.456815 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.457087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.457355 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] PATH_INFO: `/v3/projects/b35cdedf5eea4b89b9b6c97d4778d5de` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.458759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35cdedf5eea4b89b9b6c97d4778d5de)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:36.460639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:36.462686 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:36.464725 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:36.479223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:36.524036 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9099-b19c-47eb-b49a-9aff56130846 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:36.527647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:36.528249 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.528525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.528795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.537839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:36.539838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895d80-1fa2-4b47-b275-471e82f5dbc7 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:36.549124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1330/2680] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:36.718280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35cdedf5eea4b89b9b6c97d4778d5de', 'request_id': 'req-c2c22420-ade1-4a75-be46-18950c2a58e5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.804063 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35cdedf5eea4b89b9b6c97d4778d5de', 'request_id': 'req-c2c22420-ade1-4a75-be46-18950c2a58e5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.811776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35cdedf5eea4b89b9b6c97d4778d5de', 'request_id': 'req-c2c22420-ade1-4a75-be46-18950c2a58e5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.823197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] The token cache is being invalidate because project b35cdedf5eea4b89b9b6c97d4778d5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:36.823673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.824419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c2c22420-ade1-4a75-be46-18950c2a58e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:36.826121 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1351/2681] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:36 2022] DELETE /identity/v3/projects/b35cdedf5eea4b89b9b6c97d4778d5de => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:36.831521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.835610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.835610 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.855026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:36.856542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:36.917699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1331/2682] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:36.926767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.928519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.928519 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.946633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:36.947950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:36.956018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1352/2683] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:36.960071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:36.970168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1bdde-91ff-46d4-89a7-71a34c503f5c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:36.974848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:36.975439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:36.975711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:36.975984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:36.977183 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:36.977483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:36.979348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:36.980824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:36.991607 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1332/2684] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:54:36.996076 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.005369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2ff4-61af-4159-bddd-9a4822f06b11 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.010232 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.010906 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.011262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.011446 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.012054 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.012161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.013883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.014035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.031908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b29d6-af50-4043-9c66-1f34d5800972 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.037535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.038840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.039695 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.039970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] PATH_INFO: `/v3/projects/ea9389de67a246e48b1e780f1428f57f` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.041098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9389de67a246e48b1e780f1428f57f)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.043094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.110855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1353/2685] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:36 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:37.114822 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.160616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9389de67a246e48b1e780f1428f57f', 'request_id': 'req-bf339a69-3785-4d6c-9a79-8babae8793df'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:37.172259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9389de67a246e48b1e780f1428f57f', 'request_id': 'req-bf339a69-3785-4d6c-9a79-8babae8793df'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:37.177896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878695-aa1e-4950-97db-c11ee9ef96e5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.235424 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.236022 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.236311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.236560 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.237163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.239168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.255467 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9389de67a246e48b1e780f1428f57f', 'request_id': 'req-bf339a69-3785-4d6c-9a79-8babae8793df'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:37.267528 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] The token cache is being invalidate because project ea9389de67a246e48b1e780f1428f57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:54:37.267818 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:37.268474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-bf339a69-3785-4d6c-9a79-8babae8793df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:54:37.269969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1333/2686] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:54:37 2022] DELETE /identity/v3/projects/ea9389de67a246e48b1e780f1428f57f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:37.274930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe82e-8612-48b1-a404-590c1fa4f097 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.275205 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe82e-8612-48b1-a404-590c1fa4f097 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.275478 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe82e-8612-48b1-a404-590c1fa4f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.295326 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ab0fe82e-8612-48b1-a404-590c1fa4f097 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:37.296525 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ab0fe82e-8612-48b1-a404-590c1fa4f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.305366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1334/2687] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:37.312580 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.312962 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.313204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.331785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:37.332976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.341134 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1335/2688] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:37.342395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1354/2689] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:37.346323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.346537 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.347999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.356523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0487787-2b11-47e3-85a0-8a041a3fbe02 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.361091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc4de9-a1d3-4dd0-88eb-b07ed89ce8f1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.361287 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.361883 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.362157 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.362456 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.363092 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:54:37.363387 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.364986 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.365915 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.366573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.367460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.367868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.368551 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.370315 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.377079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1336/2690] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:54:37.380583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1355/2691] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:37.381473 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.384214 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.390143 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:37.391642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55242b-cf64-4073-972b-684e272866cd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.395269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfddb0e-9b79-4336-ab18-fe95490d6e73 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.396291 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.396922 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.397198 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.397472 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.398102 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.400023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.400319 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.401026 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.401305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.401573 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.402369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.403868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.416816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1356/2692] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:37.420782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.432024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eee93-976f-43f6-b859-ac1a2783319c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.438335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.438971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.439269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.439531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] PATH_INFO: `/v3/projects/66ab7e2f4bbd43f4a795a5f1068a32f9/users/35306cf75bde4fdcbb1374fa9ab82aa7/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.457317 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab7e2f4bbd43f4a795a5f1068a32f9, user_id=35306cf75bde4fdcbb1374fa9ab82aa7, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.460059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e53f8-a6b8-4962-90ac-c8aaf91a1a1d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.484908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1337/2693] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:37.489019 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.549780 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88761bc-dc11-4478-802d-d309594873cd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.552624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1357/2694] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:37 2022] PUT /identity/v3/projects/66ab7e2f4bbd43f4a795a5f1068a32f9/users/35306cf75bde4fdcbb1374fa9ab82aa7/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:37.558323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.558611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.559298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.578291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:37.579495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.582154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:37.606122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.608875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.608875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.608875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.608875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.609733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.640840 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1358/2695] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:37.651433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.652763 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:37.709106 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515be2-b99b-401a-a50f-de2890ff8e58 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.712816 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.713417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.713696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.713969 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.722901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.724336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.730148 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1338/2696] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:54:37.734159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.734314 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1359/2697] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:54:37.744464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5bfa3-a688-412a-bea1-eee00e2ad7d7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.749007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.749596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.749868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.750139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.750799 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.752507 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.764468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1339/2698] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:37.768629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.778204 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe3851-dd83-49d8-9cb9-f22b27929c2a service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.782952 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.783536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.789146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.789146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.789146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.789146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996a9d0-db86-4f4c-a34c-7030310cb276 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.796027 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1360/2699] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:37.800299 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:37.810608 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcffe3-c704-4170-aecf-04794b6853c3 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:37.815087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:37.817887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.817887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.817887 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] PATH_INFO: `/v3/projects/2ad064334a6e49719a1162b53a6b7b0e/users/ee6b61e59be8455bb272c97b040684d4/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.835485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad064334a6e49719a1162b53a6b7b0e, user_id=ee6b61e59be8455bb272c97b040684d4, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:37.838349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:37.930930 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1340/2700] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:37 2022] PUT /identity/v3/projects/2ad064334a6e49719a1162b53a6b7b0e/users/ee6b61e59be8455bb272c97b040684d4/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:37.936223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800a4e-814f-41e3-b3f9-c55391450fcb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:37.936613 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800a4e-814f-41e3-b3f9-c55391450fcb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:37.936896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800a4e-814f-41e3-b3f9-c55391450fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:37.956504 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-42800a4e-814f-41e3-b3f9-c55391450fcb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:37.957735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-42800a4e-814f-41e3-b3f9-c55391450fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:38.009388 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:38.017826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1361/2701] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:38.027516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:38.029380 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:38.096007 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e22cd1-b0d3-42b0-aa8b-bb5e589df5a9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:38.100111 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:38.100719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:38.100996 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:38.101785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:38.113043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:38.114560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:38.126054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1341/2702] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:39.643387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176403f-da8d-4bd2-9f95-089bf2b3983e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:39.643927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176403f-da8d-4bd2-9f95-089bf2b3983e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:39.643927 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176403f-da8d-4bd2-9f95-089bf2b3983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:39.676530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9176403f-da8d-4bd2-9f95-089bf2b3983e None None] MFA Rules not processed for user `ee6b61e59be8455bb272c97b040684d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:39.678215 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9176403f-da8d-4bd2-9f95-089bf2b3983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.759581 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1362/2703] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:39.767233 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:39.768755 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:39.838552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c0b0-dd52-4556-80ee-d32b7ecef344 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:39.843882 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:39.844066 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:39.844322 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:39.844590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:39.854642 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:39.856257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:39.868190 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1342/2704] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:41.797855 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df430d-2225-468d-a57a-ca67aeeebc6f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:41.798413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df430d-2225-468d-a57a-ca67aeeebc6f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:41.798518 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df430d-2225-468d-a57a-ca67aeeebc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:41.821161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b8df430d-2225-468d-a57a-ca67aeeebc6f None None] MFA Rules not processed for user `ee6b61e59be8455bb272c97b040684d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:41.822620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b8df430d-2225-468d-a57a-ca67aeeebc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:41.833480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1363/2705] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:42.192913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:42.204941 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906da4f-4cc5-4c78-b9d6-2d931d2d37a5 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:42.209144 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:42.209754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:42.210728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:42.211013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:42.212790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:42.226541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:42.226541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:42.236961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1343/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:54:43.851025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:43.852262 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:43.852984 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:43.889941 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] MFA Rules not processed for user `35306cf75bde4fdcbb1374fa9ab82aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:43.892275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:44.001371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1364/2707] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:44.005864 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.020423 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acfbe5-883c-4439-b949-a106330942dc service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.025834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.026501 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.026778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.027048 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.027685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.029583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.160191 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:44.169335 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1344/2708] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:54:44 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:44.173919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.185871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b8e6-93ed-4be5-9211-759d550bc171 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.264782 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.265505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.265787 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.266055 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.266766 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.268736 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.370980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1365/2709] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:54:44 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:54:44.375002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.386966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9ba0-36fa-4411-a501-e4c051801808 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.393910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.394762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.395042 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.395312 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.395980 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.397583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.410020 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1345/2710] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:54:44.415278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.421287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:54:44.426770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61c86d-0212-41cf-ac70-6f5383bf6d22 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.432191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.432901 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.433179 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.433445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] PATH_INFO: `/v3/projects/7dd55124e6124098a528a19cd4d2ea80/users/1ae3547921954c0ca0a4c47b72e63fa5/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.450851 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd55124e6124098a528a19cd4d2ea80, user_id=1ae3547921954c0ca0a4c47b72e63fa5, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.453619 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7357e-5e25-4267-8778-8e7c88996358 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.581971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1366/2711] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:44 2022] PUT /identity/v3/projects/7dd55124e6124098a528a19cd4d2ea80/users/1ae3547921954c0ca0a4c47b72e63fa5/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:54:44.586813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.589280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.589570 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.589846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.597204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1c95a-a8a2-4e87-9c22-2cccef83532f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.611595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] MFA Rules not processed for user `74e80391b8814b44b13a6b38d36b15ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:44.613183 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:44.670307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.670947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.671276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.671547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.672220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.673816 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17be6b-5484-423d-9e83-24d63f22b317 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.681999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1367/2712] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:54:44.685571 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1346/2713] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:54:44.690099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:44.700983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39e9b-a402-403d-946e-4c04ef946a68 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:44.705876 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:44.706615 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:44.707021 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:44.707305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] PATH_INFO: `/v3/projects/7dd55124e6124098a528a19cd4d2ea80/users/1ae3547921954c0ca0a4c47b72e63fa5/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:44.709252 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd55124e6124098a528a19cd4d2ea80, user_id=1ae3547921954c0ca0a4c47b72e63fa5, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:44.712890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:44.724134 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1368/2714] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:54:44 2022] PUT /identity/v3/projects/7dd55124e6124098a528a19cd4d2ea80/users/1ae3547921954c0ca0a4c47b72e63fa5/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:54:52.691001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403023-b0c1-41db-ae4a-bc8543f1ab52 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:52.691533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403023-b0c1-41db-ae4a-bc8543f1ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:52.691533 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10403023-b0c1-41db-ae4a-bc8543f1ab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:52.719377 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-10403023-b0c1-41db-ae4a-bc8543f1ab52 None None] MFA Rules not processed for user `1ae3547921954c0ca0a4c47b72e63fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:54:52.723466 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-10403023-b0c1-41db-ae4a-bc8543f1ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:52.787587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1347/2715] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:54:52.801344 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:54:52.803138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:54:52.877186 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7b81-d70b-4827-8eea-30b187cd3576 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:54:52.883147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:54:52.883740 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:54:52.884025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:54:52.884294 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:54:52.940665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:54:52.942301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:54:52.952473 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1369/2716] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:02.784760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=68 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:02.948209 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:18.773375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81bd4f-1e49-408b-9f08-8c7c699b9467 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:18.773851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81bd4f-1e49-408b-9f08-8c7c699b9467 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:18.773966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81bd4f-1e49-408b-9f08-8c7c699b9467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:18.792569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8a81bd4f-1e49-408b-9f08-8c7c699b9467 None None] MFA Rules not processed for user `35306cf75bde4fdcbb1374fa9ab82aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:55:18.793742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8a81bd4f-1e49-408b-9f08-8c7c699b9467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:55:18.800366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1348/2717] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:55:28.787521 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:55:49.256058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:55:49.310616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf17-3695-4c75-ae65-7aa8d180e80e service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:55:49.314237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:55:49.314839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:55:49.315117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:55:49.315390 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:55:49.324342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:55:49.326334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:55:49.335768 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1370/2718] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:55:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:55:59.331536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=26 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:01.973582 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5996-158e-4eff-835f-2ba5fbe15b0f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:01.974097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5996-158e-4eff-835f-2ba5fbe15b0f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:01.974097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5996-158e-4eff-835f-2ba5fbe15b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:01.993147 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-45cd5996-158e-4eff-835f-2ba5fbe15b0f None None] MFA Rules not processed for user `ee6b61e59be8455bb272c97b040684d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:01.994359 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-45cd5996-158e-4eff-835f-2ba5fbe15b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.048415 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1349/2719] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:02.397623 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:56:02.399058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.526858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b39821-a975-4bf4-87c8-bd33e59f8d19 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:56:02.532742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:56:02.533354 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:02.533635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:02.533905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:02.535650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:02.547328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:56:02.548968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:56:02.559034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1371/2720] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:56:12.041395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=25 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:12.554814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=41 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:56:15.855096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:56:15.855961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:56:15.856412 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:56:15.876699 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] MFA Rules not processed for user `74e80391b8814b44b13a6b38d36b15ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:56:15.877911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:56:15.933841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1350/2721] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:56:25.927260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=25 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:09.783510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:09.784980 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:09.843632 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ce3c4-a51a-4b91-9e3a-633c10bd6664 service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:09.847258 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:09.847869 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:09.848146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:09.848414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:09.850144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:09.883086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:09.884524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:09.907103 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1372/2722] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:10.499522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:10.563308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86b775-6c84-4a7a-9150-2cd02e1b16f2 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:10.567802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:10.568426 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:10.568705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:10.568976 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] PATH_INFO: `/v3/users/ee6b61e59be8455bb272c97b040684d4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:10.570086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6b61e59be8455bb272c97b040684d4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:10.572070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:10.779848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6b61e59be8455bb272c97b040684d4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:10.780486 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6b61e59be8455bb272c97b040684d4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:10.792385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6b61e59be8455bb272c97b040684d4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:10.891464 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6b61e59be8455bb272c97b040684d4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:10.892079 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-6e698296-ff2c-4cb4-a107-570f09896ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6b61e59be8455bb272c97b040684d4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:10.904795 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1351/2723] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:57:10 2022] DELETE /identity/v3/users/ee6b61e59be8455bb272c97b040684d4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:57:11.145238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:11.157000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dab23-8c4f-453e-85c3-b6eccf2d342c service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:11.213995 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:11.214587 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.215475 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.215792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] PATH_INFO: `/v3/projects/2ad064334a6e49719a1162b53a6b7b0e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.216953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad064334a6e49719a1162b53a6b7b0e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:11.218871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:11.372637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad064334a6e49719a1162b53a6b7b0e', 'request_id': 'req-40992b50-f016-4240-8701-7c5ebc45c477'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:11.486509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad064334a6e49719a1162b53a6b7b0e', 'request_id': 'req-40992b50-f016-4240-8701-7c5ebc45c477'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:11.493479 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad064334a6e49719a1162b53a6b7b0e', 'request_id': 'req-40992b50-f016-4240-8701-7c5ebc45c477'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:11.504755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] The token cache is being invalidate because project 2ad064334a6e49719a1162b53a6b7b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:57:11.505045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:11.505690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-40992b50-f016-4240-8701-7c5ebc45c477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:57:11.507284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1373/2724] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:57:11 2022] DELETE /identity/v3/projects/2ad064334a6e49719a1162b53a6b7b0e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:57:11.512620 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.513152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.513308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.566966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:11.568173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:11.615130 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:11.626298 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1352/2725] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:11.635583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.635866 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.636141 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.653509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:11.659358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:11.660547 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:11.669429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1374/2726] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:11.673783 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:11.683403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905b04-a0ab-4064-a7ef-e682e6eb7591 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:11.688529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:11.689123 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.689402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.689672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.690348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:57:11.690643 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:11.697671 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:11.705152 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1353/2727] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:57:11.709538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:11.718825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3743b3-1f73-4a80-b376-5a767ce9cf76 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:11.723531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:11.724124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.724398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.724665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.725280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:11.727197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:11.837550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1375/2728] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:57:11 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:57:11.841754 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:11.851789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8639c-106f-4535-aa13-7cd438ba452e admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:11.906880 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:11.907417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:11.907689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:11.907960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:11.908569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:11.910497 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:12.006670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1354/2729] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:57:11 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:57:12.010800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:12.021755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c339b-84b3-4c4f-9e3c-d9df18803079 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:12.026395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:12.026985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:12.027320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:12.027595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:12.028267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:12.029852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:12.040020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1376/2730] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:57:12.046044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:12.056420 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e49a-158f-458e-8ae6-62cc566a83a9 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:12.061612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:12.062263 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:12.062741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:12.063016 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:12.063735 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:12.065325 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ef45-08db-40a9-ae14-33ec47b4fe32 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:12.075928 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1355/2731] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:57:12.080603 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:12.090761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80848fe3-6fd5-4869-b89b-d5d1f2d67e32 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:12.095372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:12.096018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:12.096298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:12.096572 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] PATH_INFO: `/v3/projects/5b4fa853dfd2483c8a3c2ac357f1af52/users/bf10481821f149659859eff51f9c8cbb/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:12.112024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4fa853dfd2483c8a3c2ac357f1af52, user_id=bf10481821f149659859eff51f9c8cbb, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:12.114700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:12.189267 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1377/2732] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:57:12 2022] PUT /identity/v3/projects/5b4fa853dfd2483c8a3c2ac357f1af52/users/bf10481821f149659859eff51f9c8cbb/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:57:12.194103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6d67-a25d-4c1d-905b-bdd237257fe5 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:12.194479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6d67-a25d-4c1d-905b-bdd237257fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:12.194759 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf6d67-a25d-4c1d-905b-bdd237257fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:12.214113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-3fbf6d67-a25d-4c1d-905b-bdd237257fe5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:12.215428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3fbf6d67-a25d-4c1d-905b-bdd237257fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:12.274728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1356/2733] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:12.284710 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:12.286484 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:12.343193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb209136-42c5-43c5-b78b-46558c871ca0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:12.346837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:12.347436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:12.347717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:12.347991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:12.357650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:12.359099 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:12.368422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1378/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:17.477605 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:17.478171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:17.478171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:17.519454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] MFA Rules not processed for user `bf10481821f149659859eff51f9c8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:17.520690 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:17.579220 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:17.596853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1357/2735] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:17.601777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:17.613129 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9dd41-c9ab-4ca1-af91-8a979199202e service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:17.620281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:17.620281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:17.620281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:17.620281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:17.620690 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:17.621706 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:17.727170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:17.736748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1379/2736] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:57:17 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:57:17.749730 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5d85-232b-4c4c-8128-f34b9e18abbd None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:17.830992 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:17.831719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:17.832204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:17.832542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:17.833406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:17.835744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:17.927514 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1358/2737] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:57:17 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:57:17.931852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:17.944983 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe99aa-9081-42e9-9f1f-38ad1ad4f96c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:17.950287 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:17.951512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:17.951758 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:17.952265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:17.952910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:17.955521 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:17.970266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1380/2738] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:57:17.974792 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:17.985825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e660b2-890f-4a9e-af76-fc4fc5dfe3b2 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:17.990696 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:17.991495 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:17.991838 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:17.992183 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] PATH_INFO: `/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521/users/e71a30509bba4584adedae456db86a09/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:18.010518 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f2cbb852fe48b09a99ecf9a5eb2521, user_id=e71a30509bba4584adedae456db86a09, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:18.013813 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:18.077023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1359/2739] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:57:17 2022] PUT /identity/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521/users/e71a30509bba4584adedae456db86a09/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:57:18.081291 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:18.106956 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5858ed-6894-4463-b5a1-dc5068d3d187 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:18.174675 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:18.175349 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:18.175629 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:18.175902 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:18.176614 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:18.178326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:18.184700 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:18.190574 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1381/2740] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:57:18.195155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:18.206003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea037-a58f-483a-82bb-7c8e815268d5 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:18.211271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:18.212067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:18.212443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:18.212790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] PATH_INFO: `/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521/users/e71a30509bba4584adedae456db86a09/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:18.215373 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f2cbb852fe48b09a99ecf9a5eb2521, user_id=e71a30509bba4584adedae456db86a09, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:18.218895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3484a7-ea6c-413d-9d55-d51d1a09b67a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:18.232003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1360/2741] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:57:18 2022] PUT /identity/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521/users/e71a30509bba4584adedae456db86a09/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:57:18.295626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:18.297398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:18.366116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c06225-0593-4d06-be90-0fc175f5f5f8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:18.426576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:18.427218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:18.427764 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:18.428020 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:18.429844 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:18.510067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:18.511541 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:18.522760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1382/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:24.095283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7106b2-6e93-4e8a-a88f-d38b89c64e8e None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:24.095837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7106b2-6e93-4e8a-a88f-d38b89c64e8e None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:24.095837 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7106b2-6e93-4e8a-a88f-d38b89c64e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:24.127269 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4e7106b2-6e93-4e8a-a88f-d38b89c64e8e None None] MFA Rules not processed for user `e71a30509bba4584adedae456db86a09`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:24.128639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4e7106b2-6e93-4e8a-a88f-d38b89c64e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:24.246484 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1361/2743] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:24.253393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:24.254905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:24.273790 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b490ef-fdcd-4477-a23d-8d1cf0cc30ad service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:24.280253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:24.280874 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:24.281152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:24.281425 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:24.374939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:24.377361 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5042f4b-a2e9-463e-92ab-b185e2773f4c service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:24.381640 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:24.389538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1383/2744] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:27.125715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:27.126203 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:27.126305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:27.148908 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] MFA Rules not processed for user `bf10481821f149659859eff51f9c8cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:27.150117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:27.157274 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1362/2745] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:30.207783 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:30.208286 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:30.208406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:30.227878 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] MFA Rules not processed for user `74e80391b8814b44b13a6b38d36b15ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:30.229095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:30.288014 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1384/2746] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:34.058409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:34.085470 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:34.124625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a985d7-2c17-43a2-bbf3-e6e1ee1f3846 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:34.129925 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:34.130314 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:34.130588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:34.130854 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:34.132839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:34.144225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:34.145640 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4fea-783a-4ceb-8a0c-557f4ec20de5 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:34.155204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1363/2747] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:40.281154 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=27 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:43.796772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:43.798399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:43.871944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca44d5-d59d-4a65-8b8c-a460e397badf None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:43.877008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:43.877654 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:43.877935 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:43.878233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:43.879964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:43.891727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:43.893342 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:43.903483 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1385/2748] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:57:44.150840 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=16 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:53.899264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=32 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:57:55.446422 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:55.446938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:55.446938 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:55.465951 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] MFA Rules not processed for user `35306cf75bde4fdcbb1374fa9ab82aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:57:55.481482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:55.521454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1364/2749] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:57:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:57:56.123416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:56.124835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:56.136084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054d691-e0d6-4a2e-915e-483ec233305a service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:56.139674 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:56.140264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:56.140552 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:56.140820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:56.142481 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:56.152181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:56.153600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:56.162120 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1386/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:57:58.529489 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:57:58.531132 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:58.547460 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ab3e4-3167-4af0-8b81-b4419476a95f None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:57:58.552773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:57:58.553365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:57:58.553702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:57:58.553943 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:57:58.555623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:57:58.567289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:57:58.568847 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:57:58.579303 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1365/2751] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:00.610907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:00.629753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e793-827a-41a1-99ec-369430a5a520 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:00.636835 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:00.637742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:00.638607 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:00.638989 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:00.641767 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:00.655971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:00.661260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:00.671622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1387/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:58:00.924535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:00.934477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9d499-3222-41af-a4d3-4f0b68e1a71e service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:00.938222 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:00.938855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:00.939192 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:00.939405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:00.949204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:00.950673 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:00.960477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1366/2753] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:02.955429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:02.968126 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca741bc-6b74-481e-b753-dce9b333e986 service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:02.974490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:02.975091 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:02.975370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:02.975638 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:02.977468 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:02.991399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:02.992994 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:03.004588 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1388/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:10.956096 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=37 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:12.999486 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=18 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:21.034164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:21.046600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74adfa-9348-4a8b-b1a3-874014ab1247 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:21.052539 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a09e02d84674a8282737d0411be459e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:21.053122 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:21.053393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:21.053664 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:21.055349 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:21.065393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:21.067058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:21.076569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1367/2755] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:31.072383 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=6 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:43.351158 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:43.361561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653ada-1428-4ada-b4fa-142bbb4af229 service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:43.365281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:43.365912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:43.366207 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:43.366508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:43.368416 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:43.437472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:43.438881 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:43.448696 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1389/2756] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:46.827765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:46.829209 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:46.844800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e09b-0915-4d65-a175-0f8470c7c6dd service nova] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:46.850023 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:46.850691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:46.850968 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:46.851236 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:46.852961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:46.868970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:46.870577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:46.880848 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1368/2757] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:46.937503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:46.939514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:46.953147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef952ab5-0614-4991-89dd-ad8265f4c98d service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:46.957981 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:46.958677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:46.958958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:46.959228 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] PATH_INFO: `/v3/users/74e80391b8814b44b13a6b38d36b15ee` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:46.960346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e80391b8814b44b13a6b38d36b15ee)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:46.963102 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:47.173676 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e80391b8814b44b13a6b38d36b15ee'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.186139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e80391b8814b44b13a6b38d36b15ee'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.251466 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e80391b8814b44b13a6b38d36b15ee'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.252104 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e80391b8814b44b13a6b38d36b15ee'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.252711 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1d519f72-3c4f-4345-80ce-2437b5048343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e80391b8814b44b13a6b38d36b15ee'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.271977 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1390/2758] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:58:46 2022] DELETE /identity/v3/users/74e80391b8814b44b13a6b38d36b15ee => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:58:47.515584 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:47.527874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad44be-7154-4083-9774-7c032b06123c service placement] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:47.591488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:47.592040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:47.592321 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:47.592596 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] PATH_INFO: `/v3/projects/e9e4366467b5436d9dcfe2618cd735cc` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:47.593875 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e4366467b5436d9dcfe2618cd735cc)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:47.595808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:47.708737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e4366467b5436d9dcfe2618cd735cc', 'request_id': 'req-b0d35692-56ba-4826-a436-a0da918e923a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.714940 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e4366467b5436d9dcfe2618cd735cc', 'request_id': 'req-b0d35692-56ba-4826-a436-a0da918e923a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.805708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e4366467b5436d9dcfe2618cd735cc', 'request_id': 'req-b0d35692-56ba-4826-a436-a0da918e923a'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.816453 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] The token cache is being invalidate because project e9e4366467b5436d9dcfe2618cd735cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:58:47.816739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.817355 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-b0d35692-56ba-4826-a436-a0da918e923a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:58:47.818891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1369/2759] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:58:47 2022] DELETE /identity/v3/projects/e9e4366467b5436d9dcfe2618cd735cc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:58:47.823777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:47.824062 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:47.824336 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:47.844265 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:58:47.845442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:47.904332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1391/2760] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:58:47.913512 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:47.914708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:47.914708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:47.934711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:58:47.935850 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:47.944188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1370/2761] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:58:47.948372 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:47.958012 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff5ce-00a6-405d-9fae-ed296aa69be5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:47.963124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:47.963712 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:47.963991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:47.964264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:47.964896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:58:47.965196 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:47.966817 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:47.968251 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:47.979420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1392/2762] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:58:47.991593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.000953 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae121ca-2f44-4fde-9b72-cf3de7aaa80c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.005715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.006271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.006548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.006817 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.007433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.009307 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.104301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1371/2763] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:58:48.108620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.118490 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c9d9c-9efe-4cdb-bb92-5d7afa0cab3f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.174332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.174923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.175194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.175459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.176056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.177934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.268626 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1393/2764] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:58:48 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:58:48.272777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.286405 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262f5e-86d1-4a77-9d35-ef9eee9b4201 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.291663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.292267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.292545 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.292819 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.293508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.295297 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.305590 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1372/2765] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:58:48.309687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.319721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ebd22-52b2-4f4c-8f95-23c80a0d4a74 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.325018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.325605 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.325880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.326146 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.326848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.328437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e7d1c-13f7-4249-8ada-f76e6cdf4f1c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.340061 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1394/2766] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:58:48.344061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.354267 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7c6c-337b-4daa-a235-9761012bc40b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.359171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.359809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.360088 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.360361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] PATH_INFO: `/v3/projects/5650729e3719467d8ad788137af12796/users/3a49ae7ab5504ccd8139109dd51b4f24/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.374721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5650729e3719467d8ad788137af12796, user_id=3a49ae7ab5504ccd8139109dd51b4f24, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.377392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.439597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1373/2767] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:58:48 2022] PUT /identity/v3/projects/5650729e3719467d8ad788137af12796/users/3a49ae7ab5504ccd8139109dd51b4f24/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:58:48.450406 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.450695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.450971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.478735 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] MFA Rules not processed for user `3a49ae7ab5504ccd8139109dd51b4f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:58:48.479968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:48.542957 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1395/2768] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:58:48.547529 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.561093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:48.608737 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0acf4-6d47-4dbf-ae35-1ee09fc8b948 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.613588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.614229 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.614700 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.615168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.616173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.618711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.696273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1374/2769] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:58:48 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:58:48.700450 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.711418 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0649e1-1a11-49ec-ae0e-eb2fb0c88a0d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.768191 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.768814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.769096 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.769369 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.770018 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.771953 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.780550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:48.874593 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1396/2770] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:58:48 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:58:48.878740 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.889612 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdada932-299a-4ae7-a377-01b6092d7cab admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.894199 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.894790 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.895065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.895333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.895965 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.897541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:48.907945 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1375/2771] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:58:48.912009 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:48.922776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104be2a-1b34-4a59-bd30-9a3f3220d927 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:48.927328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:48.927965 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:48.928240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:48.928509 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] PATH_INFO: `/v3/projects/65e4cb1259034b3abfeb4ac874973edd/users/0db7d15c33c84fa1bad82912d6f4b75c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:48.943829 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e4cb1259034b3abfeb4ac874973edd, user_id=0db7d15c33c84fa1bad82912d6f4b75c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:48.946580 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:49.046166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1397/2772] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:58:48 2022] PUT /identity/v3/projects/65e4cb1259034b3abfeb4ac874973edd/users/0db7d15c33c84fa1bad82912d6f4b75c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:58:49.050369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:49.061365 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed17cce-ac42-499c-90be-6ae22a207e35 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:49.123143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:49.123742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:49.124071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:49.124447 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:49.125463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:49.127030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039e8d0-52e6-4604-8ed9-c554349305e4 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:49.136634 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1376/2773] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:58:49.140798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:49.151221 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603fd-a675-4f96-ba64-04df1076f772 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:49.156270 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:49.156926 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:49.157236 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:49.157510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] PATH_INFO: `/v3/projects/65e4cb1259034b3abfeb4ac874973edd/users/0db7d15c33c84fa1bad82912d6f4b75c/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:49.159589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e4cb1259034b3abfeb4ac874973edd, user_id=0db7d15c33c84fa1bad82912d6f4b75c, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:49.162275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:49.172991 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1398/2774] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:58:49 2022] PUT /identity/v3/projects/65e4cb1259034b3abfeb4ac874973edd/users/0db7d15c33c84fa1bad82912d6f4b75c/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:58:49.184084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:49.184492 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:49.184775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:49.212841 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] MFA Rules not processed for user `0db7d15c33c84fa1bad82912d6f4b75c`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:58:49.214018 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:49.281320 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1377/2775] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:58:49.295684 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:49.297536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:58:49.355434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe9246-8291-4998-b5d2-e51398b1aeff admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:49.359526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:49.360116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:49.360387 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:49.360651 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:49.369343 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:49.370785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:49.380337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1399/2776] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:58:49.571011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:58:49.580685 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a964beb-52e8-48b6-a71b-f5569aee5a28 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:58:49.584372 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:58:49.584961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:58:49.585237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:58:49.586052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:58:49.591165 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:49.642744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:58:49.644169 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c2d6c-b6a0-4c8e-8201-68a416588fee service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:58:49.653672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1378/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:58:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:58:59.375903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:58:59.656845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=24 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:00.329458 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:00.392059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e0ba4-82c6-41b3-8318-b5ebba2ccd38 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:00.396589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:00.397218 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:00.397491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:00.397760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] PATH_INFO: `/v3/users/3a49ae7ab5504ccd8139109dd51b4f24` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:00.401071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a49ae7ab5504ccd8139109dd51b4f24)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:00.403625 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:00.640529 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a49ae7ab5504ccd8139109dd51b4f24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:00.655961 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a49ae7ab5504ccd8139109dd51b4f24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:00.763452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a49ae7ab5504ccd8139109dd51b4f24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:00.764064 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a49ae7ab5504ccd8139109dd51b4f24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:00.764695 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a49ae7ab5504ccd8139109dd51b4f24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:00.778231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1400/2778] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:00 2022] DELETE /identity/v3/users/3a49ae7ab5504ccd8139109dd51b4f24 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:00.782791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:00.783279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:00.783393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:00.802801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:00.804005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:00.861566 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1379/2779] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:00.871187 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:00.872606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:00.929492 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39ff3-e346-448b-ab75-18fda3a6803c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:00.933033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:00.933643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:00.933916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:00.934202 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:00.943153 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:00.944578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:00.954398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1401/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:01.382050 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:01.383578 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:01.396508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee952de-ed85-4f0e-91d8-0bb911524aeb None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:01.401924 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:01.408702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:01.408702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:01.408702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] PATH_INFO: `/v3/projects/5650729e3719467d8ad788137af12796` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:01.408702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5650729e3719467d8ad788137af12796)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:01.408702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:01.530442 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5650729e3719467d8ad788137af12796', 'request_id': 'req-f64a7d32-b014-4f6f-b8ca-88796040889b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.536739 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5650729e3719467d8ad788137af12796', 'request_id': 'req-f64a7d32-b014-4f6f-b8ca-88796040889b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.628304 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5650729e3719467d8ad788137af12796', 'request_id': 'req-f64a7d32-b014-4f6f-b8ca-88796040889b'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.638982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] The token cache is being invalidate because project 5650729e3719467d8ad788137af12796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:01.640032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.640032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.641403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1380/2781] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:01 2022] DELETE /identity/v3/projects/5650729e3719467d8ad788137af12796 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:01.645448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:01.655174 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ef9c0-2575-4715-ac7c-e0890063a31e service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:01.673788 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:01.711786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:01.712412 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:01.712707 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:01.712964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] PATH_INFO: `/v3/users/0db7d15c33c84fa1bad82912d6f4b75c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:01.714112 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db7d15c33c84fa1bad82912d6f4b75c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:01.716039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:01.896001 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db7d15c33c84fa1bad82912d6f4b75c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.908348 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db7d15c33c84fa1bad82912d6f4b75c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.988049 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db7d15c33c84fa1bad82912d6f4b75c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.988681 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db7d15c33c84fa1bad82912d6f4b75c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:01.989285 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-798e6523-c889-4b1b-a48d-8e5779536819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db7d15c33c84fa1bad82912d6f4b75c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.002208 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1402/2782] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:01 2022] DELETE /identity/v3/users/0db7d15c33c84fa1bad82912d6f4b75c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:02.451060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:02.452480 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:02.466935 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a7d32-b014-4f6f-b8ca-88796040889b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:02.523553 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:02.524173 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:02.524446 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:02.524711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] PATH_INFO: `/v3/projects/65e4cb1259034b3abfeb4ac874973edd` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:02.525794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e4cb1259034b3abfeb4ac874973edd)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:02.528391 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:02.629296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:02.645744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e4cb1259034b3abfeb4ac874973edd', 'request_id': 'req-8fede63a-3490-4a70-a5d7-bc51f3643f2c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.653025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e4cb1259034b3abfeb4ac874973edd', 'request_id': 'req-8fede63a-3490-4a70-a5d7-bc51f3643f2c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.711276 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e4cb1259034b3abfeb4ac874973edd', 'request_id': 'req-8fede63a-3490-4a70-a5d7-bc51f3643f2c'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.721572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] The token cache is being invalidate because project 65e4cb1259034b3abfeb4ac874973edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:02.721856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.722482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8fede63a-3490-4a70-a5d7-bc51f3643f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:02.724035 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1381/2783] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:02 2022] DELETE /identity/v3/projects/65e4cb1259034b3abfeb4ac874973edd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:02.730116 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:02.730622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:02.730720 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:02.750665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:02.751861 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:02.812097 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1403/2784] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:02.821247 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:02.821508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:02.821777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:02.842327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:02.847107 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:02.851541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1382/2785] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:59:02.856352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:02.869923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4bd83-d4b2-42dc-8900-17bf170f8d96 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:02.871693 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:02.871846 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:02.872059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:02.872331 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:02.872975 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:59:02.873295 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:02.874907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:02.886934 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1404/2786] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:59:02.891239 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:02.900454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79d59-4c0d-4c13-bc33-0ab9aa77c271 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:02.905716 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:02.906344 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:02.906625 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:02.906897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:02.907523 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:02.909413 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.004770 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1383/2787] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:03.008959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.019839 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148883-f8ce-4964-bc49-b82003aa7fc8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.046067 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:03.076161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.076762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.077046 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.077325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.077938 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.079888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.165678 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1405/2788] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:03 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:03.170001 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.180597 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6aa44-8ae8-4815-9250-52b6c801f59d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.185160 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.185751 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.186028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.186334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.187072 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.188648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.198494 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1384/2789] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:03.202770 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.212589 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53fa2-8331-47a1-b119-335994a805d8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.218197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.218920 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.219223 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.219496 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.220124 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.221753 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b6e95-bc77-4016-a3e3-9d678dfa31ff admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.232853 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1406/2790] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:59:03.236796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.246701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633496e-2370-49f3-9f47-d54da9087e16 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.251259 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.251888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.252161 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.252432 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] PATH_INFO: `/v3/projects/799de730b8b7401c93b4b003ff373cc8/users/a198fc5f85e844ce901532e9e3c048c3/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.267392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=799de730b8b7401c93b4b003ff373cc8, user_id=a198fc5f85e844ce901532e9e3c048c3, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.269977 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.325960 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1385/2791] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:03 2022] PUT /identity/v3/projects/799de730b8b7401c93b4b003ff373cc8/users/a198fc5f85e844ce901532e9e3c048c3/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:03.336380 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.336666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.336942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.365495 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] MFA Rules not processed for user `a198fc5f85e844ce901532e9e3c048c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:03.366714 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:03.432338 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1407/2792] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:03.437487 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.499916 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e3e5b-700a-45ae-baf6-60d6aeff50dd admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.504753 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.505350 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.505627 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.505897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.506543 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.508439 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.622375 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1386/2793] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:03 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:03.626405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.637999 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd344-ac41-4314-a9e8-4fbba0d585c3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.693798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.694422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.694727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.694997 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.695620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.697513 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.773759 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1408/2794] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:03 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:03.774917 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.785301 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a9d1-6e86-48f5-a26d-9dcf950189c7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.789899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.790463 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.790738 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.791002 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.791630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.793714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.805026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1387/2795] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:03.809836 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.819808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ed3-e3d8-40d7-9aa5-3033ac378516 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.824404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:03.825043 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:03.825320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:03.825590 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] PATH_INFO: `/v3/projects/1962d500a0c24a3ea3392f79e372af45/users/0e71a8c3dd2f428da423b1143ac975dd/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:03.840140 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1962d500a0c24a3ea3392f79e372af45, user_id=0e71a8c3dd2f428da423b1143ac975dd, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:03.842832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:03.941687 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1409/2796] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:03 2022] PUT /identity/v3/projects/1962d500a0c24a3ea3392f79e372af45/users/0e71a8c3dd2f428da423b1143ac975dd/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:03.945719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:03.955687 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b67ee-7c92-4946-b68d-8f27a9378892 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:03.974710 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:04.012025 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:04.012623 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:04.012894 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:04.013158 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:04.013779 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:04.015516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5f38-5212-4cee-91d9-b1900d379ef2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:04.026936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1388/2797] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:04.029364 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:04.034814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:04.046631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669b83a-3e34-4179-8377-b385ac7bbfaf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:04.046631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:04.046631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:04.046631 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:04.047101 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] PATH_INFO: `/v3/projects/1962d500a0c24a3ea3392f79e372af45/users/0e71a8c3dd2f428da423b1143ac975dd/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:04.048553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1962d500a0c24a3ea3392f79e372af45, user_id=0e71a8c3dd2f428da423b1143ac975dd, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:04.051227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:04.061946 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1410/2798] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:04 2022] PUT /identity/v3/projects/1962d500a0c24a3ea3392f79e372af45/users/0e71a8c3dd2f428da423b1143ac975dd/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:04.072808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:04.073087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:04.073394 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:04.099947 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] MFA Rules not processed for user `0e71a8c3dd2f428da423b1143ac975dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:04.101127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:04.167516 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1389/2799] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:04.180383 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:04.182138 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:04.238854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14e2d-9cce-4d6e-8a94-5832ea96846d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:04.242488 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:04.243080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:04.243357 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:04.243627 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:04.252437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:04.253852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:04.263201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1411/2800] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:04.399857 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:04.409969 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829050e-657c-4b00-9d82-c910996e1daa None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:04.413527 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:04.414118 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:04.414427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:04.414697 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:04.469877 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:04.471341 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a39ca9-94f4-4fc3-ac1a-ffc60dbaf686 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:04.480089 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1390/2801] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:05.042536 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:05.109762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ebfab-8d4d-4adc-8fae-2bfe081407ac service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:05.114419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:05.115045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:05.115323 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:05.115597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] PATH_INFO: `/v3/users/a198fc5f85e844ce901532e9e3c048c3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:05.116847 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a198fc5f85e844ce901532e9e3c048c3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:05.118905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:05.281891 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a198fc5f85e844ce901532e9e3c048c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:05.293967 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a198fc5f85e844ce901532e9e3c048c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:05.376527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a198fc5f85e844ce901532e9e3c048c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:05.377131 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a198fc5f85e844ce901532e9e3c048c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:05.377721 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a198fc5f85e844ce901532e9e3c048c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:05.390493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1412/2802] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:05 2022] DELETE /identity/v3/users/a198fc5f85e844ce901532e9e3c048c3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:05.395087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:05.395565 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:05.395667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:05.414428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:05.415600 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:05.453856 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:05.472356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1391/2803] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:05.482334 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:05.483738 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:05.497035 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:05.540318 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab08e-596f-4f40-bfbf-3e678f6c5f97 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:05.543912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:05.544505 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:05.544777 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:05.545045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:05.553808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:05.555249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:05.564871 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1413/2804] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:06.024296 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:06.025778 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:06.040113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbe0f7-e25b-4c8f-a471-fe26439a5f35 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:06.045609 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:06.046281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:06.046558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:06.046832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] PATH_INFO: `/v3/projects/799de730b8b7401c93b4b003ff373cc8` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:06.047993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] RBAC: Authorizing `identity:delete_project(project_id=799de730b8b7401c93b4b003ff373cc8)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:06.049892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:06.171396 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799de730b8b7401c93b4b003ff373cc8', 'request_id': 'req-0fe95f30-3afa-4115-a0e1-91aaca05feba'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.177705 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799de730b8b7401c93b4b003ff373cc8', 'request_id': 'req-0fe95f30-3afa-4115-a0e1-91aaca05feba'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.239852 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799de730b8b7401c93b4b003ff373cc8', 'request_id': 'req-0fe95f30-3afa-4115-a0e1-91aaca05feba'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.252833 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] The token cache is being invalidate because project 799de730b8b7401c93b4b003ff373cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:06.253146 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.253822 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.255294 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1392/2805] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:06 2022] DELETE /identity/v3/projects/799de730b8b7401c93b4b003ff373cc8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:06.259311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:06.269480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686c63-31a9-4d84-98a7-e1c8f0aa1817 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:06.326877 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:06.327426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:06.327704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:06.327970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] PATH_INFO: `/v3/users/0e71a8c3dd2f428da423b1143ac975dd` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:06.329194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e71a8c3dd2f428da423b1143ac975dd)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:06.331152 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:06.515561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e71a8c3dd2f428da423b1143ac975dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.527923 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e71a8c3dd2f428da423b1143ac975dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.597414 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e71a8c3dd2f428da423b1143ac975dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.597958 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e71a8c3dd2f428da423b1143ac975dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.598568 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-75afde42-9ba9-4e18-903f-ddb35e566afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e71a8c3dd2f428da423b1143ac975dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:06.611671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1414/2806] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:06 2022] DELETE /identity/v3/users/0e71a8c3dd2f428da423b1143ac975dd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:07.028221 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.030409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:07.046117 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe95f30-3afa-4115-a0e1-91aaca05feba admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.105195 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.105836 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.106114 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.106424 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] PATH_INFO: `/v3/projects/1962d500a0c24a3ea3392f79e372af45` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.107798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1962d500a0c24a3ea3392f79e372af45)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.109714 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.215544 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1962d500a0c24a3ea3392f79e372af45', 'request_id': 'req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:07.221704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1962d500a0c24a3ea3392f79e372af45', 'request_id': 'req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:07.294731 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1962d500a0c24a3ea3392f79e372af45', 'request_id': 'req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:07.301991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:07.306777 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] The token cache is being invalidate because project 1962d500a0c24a3ea3392f79e372af45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:07.307067 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:07.307701 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-3108f5d8-21ee-4561-ae39-8bfb398ee0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:07.309733 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1393/2807] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:07 2022] DELETE /identity/v3/projects/1962d500a0c24a3ea3392f79e372af45 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:07.314932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.315441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.315606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.336482 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:07.337673 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:07.367820 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:07.398115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1415/2808] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:07.406097 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.406367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.406639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.426448 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:07.427750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:07.436361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1394/2809] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:07.440606 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.451261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47de11-88b1-43b8-b6c2-df297cc5818b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.455854 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.456455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.456726 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.456993 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.457624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:59:07.457922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.459546 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.471438 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1416/2810] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:59:07.475782 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.485508 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741f13-3843-4b8a-8478-33d3b39b030c None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.490280 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.490878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.491155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.491427 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.492049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.493950 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.592672 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1395/2811] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:07.594246 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.614467 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2515b-94e8-4261-a5d9-debf9bec5873 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.672834 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.673358 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.673637 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.673907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.674562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.676474 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.800514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1417/2812] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:07 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:07.804603 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.815485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ecd95-88cc-48a9-8fb3-a32bfb23edd2 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.820054 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.821911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.821911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.821911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.821911 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.823481 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.833858 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1396/2813] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:07.837804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.847744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a6c7-1334-48f3-a02f-bb4a938ff43d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.852320 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.852910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.853185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.853455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.854128 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.856272 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dd08d-3f01-4b85-8776-307e99aae77e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.866944 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1418/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:07.871668 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:07.881465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e04d3-7f4d-46ef-8e2e-46a563546061 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:07.886014 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:07.886691 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.886970 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.887245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] PATH_INFO: `/v3/projects/daf12d27e67f4f3ba710ef57b99ff7c8/users/a68a521b633448e0b829aa74f08971ac/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:07.903758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf12d27e67f4f3ba710ef57b99ff7c8, user_id=a68a521b633448e0b829aa74f08971ac, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:07.906409 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:07.974039 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1397/2815] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:07 2022] PUT /identity/v3/projects/daf12d27e67f4f3ba710ef57b99ff7c8/users/a68a521b633448e0b829aa74f08971ac/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:07.985248 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:07.985559 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:07.985858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.018309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] MFA Rules not processed for user `a68a521b633448e0b829aa74f08971ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:08.019585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:08.083921 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1419/2816] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:08.088342 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.148332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063537e-17cf-4169-bca9-7893f27251bc admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.153392 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.153974 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.154272 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.154542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.155138 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.156999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.239509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1398/2817] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:08 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:08.243419 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.254008 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003cc0e-b530-4b3f-9fd7-fc3640901a05 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.280804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:08.310548 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.311181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.311459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.311731 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.312398 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.314325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.417391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1420/2818] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:08 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:08.421356 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.431708 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72ae-0a31-448c-b451-ddfcb254409c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.436262 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.436853 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.437131 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.437407 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.438098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.439702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.450557 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1399/2819] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:08.454472 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.464501 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed69f20-855f-4b78-9c15-d79a29e55966 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.469894 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.470576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.470899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.471169 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] PATH_INFO: `/v3/projects/4976609f676d489085707423de852f21/users/0f1f93293d674094ad6e8c956ed4a8ae/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.485924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4976609f676d489085707423de852f21, user_id=0f1f93293d674094ad6e8c956ed4a8ae, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.488578 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.535814 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1421/2820] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:08 2022] PUT /identity/v3/projects/4976609f676d489085707423de852f21/users/0f1f93293d674094ad6e8c956ed4a8ae/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:08.539956 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.549898 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b19e-4a1b-41f2-882d-3639e325201f admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.605041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.605637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.605966 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.606271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.607154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.608774 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4542fd-dd9c-483e-9cfd-2f1e5605619c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.618348 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1400/2821] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:08.622620 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.633109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a542f76-af73-40e8-9a76-c6f5030289db admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.638298 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.638950 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.639227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.639493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] PATH_INFO: `/v3/projects/4976609f676d489085707423de852f21/users/0f1f93293d674094ad6e8c956ed4a8ae/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.641440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4976609f676d489085707423de852f21, user_id=0f1f93293d674094ad6e8c956ed4a8ae, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.644079 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.654821 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1422/2822] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:08 2022] PUT /identity/v3/projects/4976609f676d489085707423de852f21/users/0f1f93293d674094ad6e8c956ed4a8ae/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:08.724475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.724758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.725040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.733458 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:08.753271 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] MFA Rules not processed for user `0f1f93293d674094ad6e8c956ed4a8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:08.754604 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:08.822465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1401/2823] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:08.833633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:08.835413 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:08.893709 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722458-6527-4f8d-b624-4d06aa58a847 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:08.897337 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:08.897929 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:08.898233 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:08.898508 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:08.952653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:08.954095 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051f925-0b8f-4980-a0fa-5ec7d0c9dae4 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:08.962832 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1423/2824] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:11.999796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:12.060194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80ccba-07d4-4ad6-951f-9e1769e99ddf None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:12.065785 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:12.066431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:12.066706 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:12.066971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] PATH_INFO: `/v3/users/a68a521b633448e0b829aa74f08971ac` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:12.068071 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68a521b633448e0b829aa74f08971ac)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:12.069967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:12.287318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68a521b633448e0b829aa74f08971ac'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:12.287995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68a521b633448e0b829aa74f08971ac'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:12.300334 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68a521b633448e0b829aa74f08971ac'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:12.379971 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68a521b633448e0b829aa74f08971ac'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:12.380588 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68a521b633448e0b829aa74f08971ac'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:12.393217 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1402/2825] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:11 2022] DELETE /identity/v3/users/a68a521b633448e0b829aa74f08971ac => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:12.397701 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:12.398227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:12.398328 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:12.417545 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:12.419426 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:12.448290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:12.476633 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1424/2826] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:12.487170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:12.488744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:12.499763 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:12.545995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796abe1-3ef5-49dd-8930-106901722e0b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:12.549465 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:12.550061 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:12.550367 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:12.550636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:12.559630 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:12.561044 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:12.570404 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1403/2827] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:12.964404 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:12.966491 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:12.980381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf58c-ff7d-4e05-80ee-c32eeddce8e4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:12.985339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:12.985968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:12.986269 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:12.986538 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] PATH_INFO: `/v3/projects/daf12d27e67f4f3ba710ef57b99ff7c8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:12.987639 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf12d27e67f4f3ba710ef57b99ff7c8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:12.990401 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:13.095978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf12d27e67f4f3ba710ef57b99ff7c8', 'request_id': 'req-8af8e48b-8f0b-4eb9-b781-a39601b31a04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.171301 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf12d27e67f4f3ba710ef57b99ff7c8', 'request_id': 'req-8af8e48b-8f0b-4eb9-b781-a39601b31a04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.178217 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf12d27e67f4f3ba710ef57b99ff7c8', 'request_id': 'req-8af8e48b-8f0b-4eb9-b781-a39601b31a04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.189243 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] The token cache is being invalidate because project daf12d27e67f4f3ba710ef57b99ff7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:13.189530 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.190166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.191762 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1425/2828] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:12 2022] DELETE /identity/v3/projects/daf12d27e67f4f3ba710ef57b99ff7c8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:13.196538 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:13.211723 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3f2c-b484-4632-8de5-ee372472f668 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:13.267393 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:13.268040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:13.268293 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:13.268561 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] PATH_INFO: `/v3/users/0f1f93293d674094ad6e8c956ed4a8ae` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:13.269663 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1f93293d674094ad6e8c956ed4a8ae)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:13.271648 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:13.503936 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1f93293d674094ad6e8c956ed4a8ae'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.504594 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1f93293d674094ad6e8c956ed4a8ae'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.516576 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1f93293d674094ad6e8c956ed4a8ae'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.662254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1f93293d674094ad6e8c956ed4a8ae'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.662872 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-4a59e537-5b69-4ca8-a7fc-3af9cbe94b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1f93293d674094ad6e8c956ed4a8ae'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:13.676592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1404/2829] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:13 2022] DELETE /identity/v3/users/0f1f93293d674094ad6e8c956ed4a8ae => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:14.052890 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.054381 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:14.069569 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e48b-8f0b-4eb9-b781-a39601b31a04 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.128445 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.129084 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.129365 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.129659 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] PATH_INFO: `/v3/projects/4976609f676d489085707423de852f21` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.130850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4976609f676d489085707423de852f21)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.132747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.266033 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4976609f676d489085707423de852f21', 'request_id': 'req-1184e059-518b-4493-b82b-4e78af2bd72f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:14.336280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4976609f676d489085707423de852f21', 'request_id': 'req-1184e059-518b-4493-b82b-4e78af2bd72f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:14.343373 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4976609f676d489085707423de852f21', 'request_id': 'req-1184e059-518b-4493-b82b-4e78af2bd72f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:14.344595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:14.354393 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] The token cache is being invalidate because project 4976609f676d489085707423de852f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:14.357088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:14.357088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1184e059-518b-4493-b82b-4e78af2bd72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:14.357088 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1426/2830] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:14 2022] DELETE /identity/v3/projects/4976609f676d489085707423de852f21 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:14.361961 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.362515 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.362614 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.383542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:14.385830 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:14.411809 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:14.444821 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1405/2831] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:14.452882 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.453163 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.453433 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.473457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:14.474667 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:14.482932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1427/2832] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:14.487043 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.496676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abe996-2b40-4b5d-991a-f14bf9d1760a None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.501237 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.501825 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.502103 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.502406 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.503041 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:59:14.503337 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.504902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.516654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1406/2833] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 12:59:14.520754 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.530524 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274792f-b9d0-4408-9d54-dcdc448fc615 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.535281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.535914 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.536193 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.536463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.537110 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.539041 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.617249 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1428/2834] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:14.621235 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.631624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7debe-6b3d-4847-9e0a-d5e191e1a04c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.687560 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.688168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.688445 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.688736 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.689333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.691264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.765772 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1407/2835] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:14 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:14.770071 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.780803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e08ba-e2a2-46b4-ba90-f26e0aed5f64 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.785549 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.786139 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.786436 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.786703 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.787327 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.788939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.798808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1429/2836] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:14.802798 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.813011 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725618f-2c0e-4836-b8ae-5c22216dcb8b admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.817583 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.818166 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.818462 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.818724 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.819346 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.820902 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019ef5c-9461-4efd-b4ff-62037053538d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.832094 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1408/2837] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 12:59:14.836250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:14.846428 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85f6a-e697-4615-9769-83559a895099 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:14.851115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:14.851755 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.852034 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.852313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] PATH_INFO: `/v3/projects/ee2869b7c3e5484498479febe5d96774/users/d39fbe4b1fdb4054870b37f8ab615ab6/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:14.869017 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2869b7c3e5484498479febe5d96774, user_id=d39fbe4b1fdb4054870b37f8ab615ab6, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:14.871635 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:14.970831 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1430/2838] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:14 2022] PUT /identity/v3/projects/ee2869b7c3e5484498479febe5d96774/users/d39fbe4b1fdb4054870b37f8ab615ab6/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:14.980728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:14.981005 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:14.982058 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:15.013309 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] MFA Rules not processed for user `d39fbe4b1fdb4054870b37f8ab615ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:15.014851 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:15.078787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1409/2839] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:15.089804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:15.091493 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:15.147618 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915fdfa-5f40-47e3-a444-9f27a8364fcc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:15.151168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:15.151761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:15.152038 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:15.152308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:15.160650 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:15.162575 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30d449-0041-4d86-89f1-73909458ba94 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:15.171461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1431/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:25.075895 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:25.166864 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:37.199505 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:37.261084 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321f1e-f1ad-44a6-a031-949dc8ffdeb0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:37.266862 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:37.267658 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:37.267929 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:37.268194 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] PATH_INFO: `/v3/users/d39fbe4b1fdb4054870b37f8ab615ab6` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:37.269593 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39fbe4b1fdb4054870b37f8ab615ab6)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:37.271563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:37.450395 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39fbe4b1fdb4054870b37f8ab615ab6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:37.450934 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39fbe4b1fdb4054870b37f8ab615ab6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:37.462417 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39fbe4b1fdb4054870b37f8ab615ab6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:37.536385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39fbe4b1fdb4054870b37f8ab615ab6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:37.536997 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39fbe4b1fdb4054870b37f8ab615ab6'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:37.549855 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1410/2841] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:37 2022] DELETE /identity/v3/users/d39fbe4b1fdb4054870b37f8ab615ab6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:37.554264 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:37.554750 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:37.554857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:37.575070 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:37.576293 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:37.635197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1432/2842] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:37.644983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:37.646441 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:37.703598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564f62-ddb4-4ef3-8838-eec914a4321d admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:37.707116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:37.707715 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:37.708026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:37.708308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:37.717049 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:37.718526 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b161-3603-4b0e-b2c7-d36ecc280b0e service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:37.727756 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1411/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:38.137727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.143461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:38.150872 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4863f88-7c96-44a4-9b05-2fada47306c1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.155442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.156579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.156850 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.157109 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] PATH_INFO: `/v3/projects/ee2869b7c3e5484498479febe5d96774` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.158266 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2869b7c3e5484498479febe5d96774)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.160173 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.301562 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2869b7c3e5484498479febe5d96774', 'request_id': 'req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:38.387308 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2869b7c3e5484498479febe5d96774', 'request_id': 'req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:38.394329 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2869b7c3e5484498479febe5d96774', 'request_id': 'req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:38.404595 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] The token cache is being invalidate because project ee2869b7c3e5484498479febe5d96774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:38.404880 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:38.405500 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0cc022a8-c96c-46bb-8f8e-517364f2f9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:38.407608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1433/2844] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:38 2022] DELETE /identity/v3/projects/ee2869b7c3e5484498479febe5d96774 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:38.412436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.412896 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.413154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.432150 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:38.433368 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:38.450403 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:38.493225 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1412/2845] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:59:38.501168 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.501447 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.501719 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.521781 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:38.523003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:38.530884 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1434/2846] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 12:59:38.535639 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.545796 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f9527-4019-43d8-9ee6-1ffa57f59d48 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.550546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.551913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.551913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.551913 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.552488 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:59:38.552789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.554443 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.566621 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1413/2847] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:59:38.570954 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.580769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20bf9-d5fb-4507-bb79-392e5e9a55e4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.585611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.586226 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.586507 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.586800 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.587427 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.589395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.718050 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1435/2848] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:38 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:38.722288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.732558 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c584e-5b17-4c33-882c-7616bacd6a66 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.787032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.787622 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.787899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.788170 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.788787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.790726 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.879657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1414/2849] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:38 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:38.883584 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.894197 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53bf7e-2efe-4116-a7d0-17663057902b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.898761 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.899356 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.899621 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.899888 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.900511 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.902086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.911848 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1436/2850] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:38.915490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.925679 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5b17-2aa1-45aa-aa8d-f911c5f27d41 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.930202 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.930834 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.931109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.931376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.931999 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.933572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4b56c-62ae-4f6e-ba5e-9a1db2516316 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:38.944483 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1415/2851] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:38.948516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:38.958312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca864-12f8-4f77-ba2d-4c0afd62a12a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:38.962896 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:38.963677 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:38.963959 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:38.964231 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] PATH_INFO: `/v3/projects/c410db0bde8c41f18019f07b5e96642e/users/1a2c4a495bc34020be6838e604ed7cb4/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:38.978441 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c410db0bde8c41f18019f07b5e96642e, user_id=1a2c4a495bc34020be6838e604ed7cb4, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:38.981045 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:39.045698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1437/2852] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:38 2022] PUT /identity/v3/projects/c410db0bde8c41f18019f07b5e96642e/users/1a2c4a495bc34020be6838e604ed7cb4/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:39.059099 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:39.059431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:39.059762 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:39.091885 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] MFA Rules not processed for user `1a2c4a495bc34020be6838e604ed7cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:39.093073 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:39.156998 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1416/2853] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:39.167765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:39.169577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:39.192031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:39.227860 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d6667-2cd5-4620-a570-09b84ca0779f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:39.231577 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:39.232430 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:39.232826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:39.233003 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:39.241237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:39.242643 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ced302-cd6f-40b1-8ccf-9b8a6409cb52 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:39.251683 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1438/2854] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:49.153410 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:49.276666 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=17 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:50.780598 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:50.842541 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b7ecd-81f4-40ec-8ea8-421c89ed0173 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:50.847655 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:50.848273 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:50.848547 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:50.848845 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] PATH_INFO: `/v3/users/1a2c4a495bc34020be6838e604ed7cb4` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:50.849948 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2c4a495bc34020be6838e604ed7cb4)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:50.851878 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:50.989892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2c4a495bc34020be6838e604ed7cb4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:50.990616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2c4a495bc34020be6838e604ed7cb4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.002431 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2c4a495bc34020be6838e604ed7cb4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.064444 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2c4a495bc34020be6838e604ed7cb4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.065078 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2c4a495bc34020be6838e604ed7cb4'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.077226 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1417/2855] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 12:59:50 2022] DELETE /identity/v3/users/1a2c4a495bc34020be6838e604ed7cb4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:51.082144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:51.082668 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:51.082776 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:51.101826 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:51.103044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:51.160660 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1439/2856] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:51.170421 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:51.171828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:51.228744 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab51eb9-de10-49d7-b597-cbea98229537 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:51.232647 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:51.233245 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:51.233520 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:51.233791 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:51.242665 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:51.244081 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cba47-3cc0-430f-a027-132fda1b5e28 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:51.253897 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1418/2857] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:51.671905 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:51.675442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:51.688199 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6c11-169b-4203-a82e-5aebf042958e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:51.694528 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:51.698322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:51.698322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:51.698322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] PATH_INFO: `/v3/projects/c410db0bde8c41f18019f07b5e96642e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:51.698322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c410db0bde8c41f18019f07b5e96642e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:51.699608 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:51.820852 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c410db0bde8c41f18019f07b5e96642e', 'request_id': 'req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.916239 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c410db0bde8c41f18019f07b5e96642e', 'request_id': 'req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.922744 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c410db0bde8c41f18019f07b5e96642e', 'request_id': 'req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.933622 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] The token cache is being invalidate because project c410db0bde8c41f18019f07b5e96642e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 12:59:51.933907 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.934553 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b1b3c595-34ac-4b26-8a6f-e8152ee90a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 12:59:51.936031 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1440/2858] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 12:59:51 2022] DELETE /identity/v3/projects/c410db0bde8c41f18019f07b5e96642e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:51.941490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:51.942004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:51.942004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:51.960871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:51.962045 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:51.979264 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:52.020636 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1419/2859] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:52.028457 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.028747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.029025 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.049948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:52.052250 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:52.058947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1441/2860] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:52.063003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.073502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e195-9352-4238-ac80-69516629cbbd None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.077975 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.080918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.080918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.080918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.080918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81881) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 12:59:52.080918 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.081910 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.093376 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1420/2861] 10.222.0.15 () {58 vars in 1153 bytes} [Mon Aug 22 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 12:59:52.097912 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.106985 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ad8e-c597-4d30-a6b4-43ec22d8cb20 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.112384 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.112964 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.113237 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.113503 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.114114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.116015 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.203220 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1442/2862] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:52 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:52.207211 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.217100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09d339-bf77-4401-a7a4-d17a96f6f3a7 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.271990 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.272616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.272892 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.273159 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] PATH_INFO: `/v3/users` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.273832 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.275835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.363053 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1421/2863] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:52 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 12:59:52.367077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.377260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a90c67-de6b-4707-846c-271a89f70df4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.381819 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.382440 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.382717 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.382986 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.383611 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.385185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.395363 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1443/2864] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:52.399188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.410327 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc18d-1c99-425c-86f0-2c1b01cff323 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.414889 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.415469 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.415741 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.416009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.416633 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.418288 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfa6c7-2479-43e9-9682-5755d83db130 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.429135 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1422/2865] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:52.433053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.443558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9351e-a4e4-4d05-8fa8-5c48accd0114 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.448166 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.448857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.449117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.449389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] PATH_INFO: `/v3/projects/dc8d034424a64918a43ca2b961aa2063/users/af21f5997a3240a09dbcaab6d1580eef/roles/2816f759300c43c69378fdf8eaca6e20` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.464747 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8d034424a64918a43ca2b961aa2063, user_id=af21f5997a3240a09dbcaab6d1580eef, role_id=2816f759300c43c69378fdf8eaca6e20)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.467391 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.571420 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1444/2866] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:52 2022] PUT /identity/v3/projects/dc8d034424a64918a43ca2b961aa2063/users/af21f5997a3240a09dbcaab6d1580eef/roles/2816f759300c43c69378fdf8eaca6e20 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 12:59:52.576402 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.576689 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.576959 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.595399 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] MFA Rules not processed for user `eb451a0ed5164dd0a6301058cedf4d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:52.596586 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:52.654369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1423/2867] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:52.664002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:52.665751 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:52.687713 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:52.722960 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0157ba5-3267-4d0b-9a5a-91228d9d8b3b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:52.726531 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:52.727125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:52.727399 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:52.727665 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:52.736742 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:52.738837 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042dbcb-f449-4b16-b4c4-c54c8bc55381 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:52.748963 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1445/2868] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 12:59:56.880587 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:56.882278 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:56.924638 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 12:59:56.963086 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb2fcc-5a2f-4503-ae3d-281112a218d0 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:56.963775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:56.964385 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:56.964661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:56.964933 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:56.966794 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:57.027433 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:57.028786 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:57.038589 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1424/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 12:59:58.154423 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.159058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.159058 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.184068 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] MFA Rules not processed for user `af21f5997a3240a09dbcaab6d1580eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 12:59:58.185280 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 12:59:58.269971 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1446/2870] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 12:59:58.274957 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.286261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e4bb-fb93-45ef-b7f9-f4afe25651e9 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.291871 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.292485 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.292760 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.293030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.293670 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.295624 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.430029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1425/2871] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Aug 22 12:59:58 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:58.434238 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.445756 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a4319-ffc7-4b6d-9807-693f4bef6af5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.501804 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.502448 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.502729 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.503002 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.503624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.506136 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.587903 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1447/2872] 10.222.0.15 () {60 vars in 1144 bytes} [Mon Aug 22 12:59:58 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 12:59:58.592000 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.602305 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a74440-4999-4f09-8c26-c2e4d5c0e2bf admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.607060 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.610142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.610142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.610142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.610142 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.611188 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.625475 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1426/2873] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:58.627898 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.638586 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b14b1-57e1-4d07-9354-db0b9f5aac56 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.643311 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.644000 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.644284 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.644556 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] PATH_INFO: `/v3/projects/bb2a5d887b724b15b9dab865064a84b2/users/9ab0f16c96644a92acc3bb3b4b0da708/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.661459 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2a5d887b724b15b9dab865064a84b2, user_id=9ab0f16c96644a92acc3bb3b4b0da708, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.664176 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.736194 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1448/2874] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:58 2022] PUT /identity/v3/projects/bb2a5d887b724b15b9dab865064a84b2/users/9ab0f16c96644a92acc3bb3b4b0da708/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 12:59:58.740860 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.750874 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948dad4-bbce-480d-965f-3f325acb3d8c admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.807308 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.807919 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.808227 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.808503 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.809136 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.810765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb765d-cffb-4312-994d-16610a09b3c2 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.820575 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1427/2875] 10.222.0.15 () {58 vars in 1122 bytes} [Mon Aug 22 12:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 12:59:58.824910 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 12:59:58.835462 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef61fa6-81d6-4d76-82a0-cbda9b355aea admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 12:59:58.840118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 12:59:58.840813 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 12:59:58.841089 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 12:59:58.841352 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] PATH_INFO: `/v3/projects/bb2a5d887b724b15b9dab865064a84b2/users/9ab0f16c96644a92acc3bb3b4b0da708/roles/4a6fa889264e479ba977b250b6f0a495` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 12:59:58.843310 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2a5d887b724b15b9dab865064a84b2, user_id=9ab0f16c96644a92acc3bb3b4b0da708, role_id=4a6fa889264e479ba977b250b6f0a495)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 12:59:58.845942 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 12:59:58.857932 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1449/2876] 10.222.0.15 () {60 vars in 1483 bytes} [Mon Aug 22 12:59:58 2022] PUT /identity/v3/projects/bb2a5d887b724b15b9dab865064a84b2/users/9ab0f16c96644a92acc3bb3b4b0da708/roles/4a6fa889264e479ba977b250b6f0a495 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:00:04.792029 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bc3e-4429-4f73-88ea-8acc5375e85a None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:04.792995 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bc3e-4429-4f73-88ea-8acc5375e85a None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:04.793459 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5bc3e-4429-4f73-88ea-8acc5375e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:04.836522 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-e1a5bc3e-4429-4f73-88ea-8acc5375e85a None None] MFA Rules not processed for user `9ab0f16c96644a92acc3bb3b4b0da708`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:00:04.837982 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-e1a5bc3e-4429-4f73-88ea-8acc5375e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:04.879429 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:04.917542 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1428/2877] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 13:00:04.929150 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:04.930968 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:04.935970 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:05.010463 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601c321-a92c-41c3-8888-c5ea538f3465 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:05.014086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21a5d7a9a2043adb471333fd3589f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:05.014769 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:05.015257 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:05.015704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:05.073044 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:05.074525 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:05.083919 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1450/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:00:05.315569 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a36f-94a3-40ba-a761-120b7aa496d0 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:05.315884 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a36f-94a3-40ba-a761-120b7aa496d0 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:05.316154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a36f-94a3-40ba-a761-120b7aa496d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:05.386719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-8c74a36f-94a3-40ba-a761-120b7aa496d0 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:00:05.388009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8c74a36f-94a3-40ba-a761-120b7aa496d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:05.462366 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1429/2879] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 13:00:05.607805 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:05.609240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:05.705922 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e093-0276-4561-a1f8-ce0c064a18b6 service glance] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:05.711245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:05.711858 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:05.712241 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:05.712583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:05.721370 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:05.723074 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:05.731857 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1451/2880] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 13:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 13:00:07.066037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:07.066983 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:07.067436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:07.089984 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] MFA Rules not processed for user `35306cf75bde4fdcbb1374fa9ab82aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:00:07.091490 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:07.199903 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1430/2881] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 13:00:07.785115 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:07.787066 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:07.803086 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:07.880253 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b2c5e-8d0c-4f48-96bd-acc340936c9c service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:07.888392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:07.889028 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:07.889306 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:07.889579 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:07.891461 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:07.904799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:07.906305 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:07.917125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1452/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:00:16.623369 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:16.637721 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb45d-f8a1-490d-986a-ecf1583e2641 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:16.638635 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:16.639479 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:16.639828 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:16.640167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:16.642028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:16.653289 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:16.654808 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89eda2-1f23-4a09-8a09-cfdd894b0a29 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:16.664087 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1431/2883] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:00:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:00:17.795056 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:17.804147 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f787aa-6136-49a2-bc2f-977f105782a2 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:17.807916 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:17.809645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:17.809645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:17.809645 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:17.811435 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:17.821747 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cd91-1fe1-49a7-99cc-c0ea280bf041 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:17.822292 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cd91-1fe1-49a7-99cc-c0ea280bf041 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:17.822449 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970cd91-1fe1-49a7-99cc-c0ea280bf041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:17.843888 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-0970cd91-1fe1-49a7-99cc-c0ea280bf041 None None] MFA Rules not processed for user `af21f5997a3240a09dbcaab6d1580eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:00:17.845283 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-0970cd91-1fe1-49a7-99cc-c0ea280bf041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:17.853801 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1432/2884] 10.222.0.15 () {58 vars in 958 bytes} [Mon Aug 22 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 13:00:17.904040 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:17.905698 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:17.935290 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1453/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:00:22.513468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:22.514030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:22.514030 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:22.533811 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:00:22.535127 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:00:22.542563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1433/2886] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Aug 22 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 13:00:22.555339 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:22.567059 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78747-4c49-4723-b62e-7bcd6dc64be0 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:22.572924 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:22.573522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:22.573798 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:22.574100 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:22.594515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:22.594515 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:22.594948 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1454/2887] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 13:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 13:00:32.528993 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=94 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:32.591281 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=62 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:00:52.550891 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:00:52.560428 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475736dc-adf8-4ff0-8a3d-415ea4330f37 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:00:52.564037 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:00:52.564626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:00:52.564899 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:00:52.565167 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:00:52.574398 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:00:52.575802 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:00:52.585093 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1434/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:01:02.581004 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=6 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:01:16.487335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:01:16.488733 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:01:16.559624 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbe3ed-689a-4b82-a650-9053401f077c service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:01:16.564512 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:01:16.565105 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:01:16.565392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:01:16.565655 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:01:16.567377 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:01:16.578725 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:01:16.580278 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:01:16.590786 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1455/2889] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:01:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:01:26.585899 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=32 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:10.910193 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:10.912024 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:10.972555 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188b01a-4a5a-41e5-b906-9f74416864e0 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:10.976070 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384e6654dbac4182900d6326eb23182b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:10.976676 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:10.977009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:10.977285 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:10.979052 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:11.002248 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:11.004254 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:11.015927 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1435/2890] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:02:12.548260 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:12.561429 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732129-b055-4e37-ac34-35d18c9ea80f service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:12.567561 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:12.569939 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:12.570523 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:12.570789 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:12.574240 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:12.655868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:12.657392 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:12.669309 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1456/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:02:17.958972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:17.960381 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:17.978124 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9c7c9-3764-4cb5-a0bd-178de07ffc95 service cinder] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:17.983252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:17.985471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:17.985471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:17.985471 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:17.986657 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:17.999155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:18.000886 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19975fe-2c82-4c87-88f4-294a18adc1d9 service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:18.011546 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1436/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:02:18.131326 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:18.132779 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:18.146825 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0a52-fb61-4569-ad43-af89a22c19e6 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:18.152452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:18.152452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:18.152452 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:18.152803 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] PATH_INFO: `/v3/users/bf10481821f149659859eff51f9c8cbb` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:18.153797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf10481821f149659859eff51f9c8cbb)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:18.155734 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:18.424024 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf10481821f149659859eff51f9c8cbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:18.435785 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf10481821f149659859eff51f9c8cbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:18.507325 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf10481821f149659859eff51f9c8cbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:18.508313 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf10481821f149659859eff51f9c8cbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:18.509092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf10481821f149659859eff51f9c8cbb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:18.543514 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1457/2893] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:18 2022] DELETE /identity/v3/users/bf10481821f149659859eff51f9c8cbb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 13:02:18.707728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] REQUEST_METHOD: `POST` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:18.708009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:18.708281 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:18.728548 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.auth.core [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] MFA Rules not processed for user `94795892e1d54081a2e10d2f55bb6a08`. Rule list: `[]` (Enabled: `True`). {{(pid=81881) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 13:02:18.729750 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:18.786907 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1437/2894] 10.222.0.15 () {58 vars in 967 bytes} [Mon Aug 22 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 13:02:18.814048 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:18.816087 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:18.831932 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:18.833967 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:18.892558 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553593f-6741-461d-871a-03a9f50b7c4d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:18.897592 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:18.898254 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:18.899125 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:18.899405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] PATH_INFO: `/v3/projects/5b4fa853dfd2483c8a3c2ac357f1af52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:18.900527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4fa853dfd2483c8a3c2ac357f1af52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:18.902526 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:18.908849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ca5e9-0e2d-4163-bbc2-d8b1621ad7f1 None None] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:18.913671 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:18.914758 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4375f94a202a43c3abf6b36dd1eb01dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:18.915468 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:18.915764 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:18.916040 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:18.925572 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:18.927268 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:18.935509 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1438/2895] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Aug 22 13:02:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 13:02:18.991808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4fa853dfd2483c8a3c2ac357f1af52', 'request_id': 'req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.033656 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4fa853dfd2483c8a3c2ac357f1af52', 'request_id': 'req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.041417 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4fa853dfd2483c8a3c2ac357f1af52', 'request_id': 'req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.053346 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] The token cache is being invalidate because project 5b4fa853dfd2483c8a3c2ac357f1af52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:19.053642 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.054332 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.055897 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1458/2896] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:18 2022] DELETE /identity/v3/projects/5b4fa853dfd2483c8a3c2ac357f1af52 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:19.059869 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:19.070577 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a2e25-a570-4a87-a718-5d149909c614 service swift] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:19.090032 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=100 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:19.126243 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:19.126868 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:19.127279 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:19.127552 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] PATH_INFO: `/v3/users/e71a30509bba4584adedae456db86a09` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:19.128702 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71a30509bba4584adedae456db86a09)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:19.130637 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:19.309482 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71a30509bba4584adedae456db86a09'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.310145 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71a30509bba4584adedae456db86a09'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.326414 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71a30509bba4584adedae456db86a09'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.410261 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71a30509bba4584adedae456db86a09'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.410839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71a30509bba4584adedae456db86a09'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.423563 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1439/2897] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:19 2022] DELETE /identity/v3/users/e71a30509bba4584adedae456db86a09 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:19.680966 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:19.682449 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:19.696360 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df2e8d-4a4d-4a04-8bc3-c0fe0ce6bf9b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:19.757510 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:19.758534 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:19.758807 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:19.759072 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] PATH_INFO: `/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:19.760201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f2cbb852fe48b09a99ecf9a5eb2521)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:19.762092 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:19.906275 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f2cbb852fe48b09a99ecf9a5eb2521', 'request_id': 'req-938314ec-6fad-48d0-84ab-fad29712d36c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.982571 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f2cbb852fe48b09a99ecf9a5eb2521', 'request_id': 'req-938314ec-6fad-48d0-84ab-fad29712d36c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:19.990259 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f2cbb852fe48b09a99ecf9a5eb2521', 'request_id': 'req-938314ec-6fad-48d0-84ab-fad29712d36c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:20.001039 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] The token cache is being invalidate because project 18f2cbb852fe48b09a99ecf9a5eb2521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:20.001312 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:20.001962 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:20.003694 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1459/2898] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:19 2022] DELETE /identity/v3/projects/18f2cbb852fe48b09a99ecf9a5eb2521 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:25.069009 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:25.070551 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:25.144876 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b529-3467-40e2-8802-e4e8f3349798 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:25.218076 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:25.218879 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:25.219332 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:25.219921 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:25.224457 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:25.242626 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:25.339098 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:25.340835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:25.353164 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1440/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:02:27.034335 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:27.038765 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:27.067868 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:27.101201 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938314ec-6fad-48d0-84ab-fad29712d36c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:27.106455 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:27.107077 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:27.107350 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:27.107616 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] PATH_INFO: `/v3/users/af21f5997a3240a09dbcaab6d1580eef` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:27.108947 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] RBAC: Authorizing `identity:delete_user(user_id=af21f5997a3240a09dbcaab6d1580eef)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:27.111227 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:27.336118 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af21f5997a3240a09dbcaab6d1580eef'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.351535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af21f5997a3240a09dbcaab6d1580eef'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.432576 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af21f5997a3240a09dbcaab6d1580eef'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.433181 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af21f5997a3240a09dbcaab6d1580eef'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.433808 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af21f5997a3240a09dbcaab6d1580eef'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.447185 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1460/2900] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:27 2022] DELETE /identity/v3/users/af21f5997a3240a09dbcaab6d1580eef => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:27.749654 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:27.777256 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db2a9-b40c-4cd0-b1aa-808e0b1e7703 service neutron] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:27.834800 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:27.835430 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:27.835704 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:27.835972 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] PATH_INFO: `/v3/projects/dc8d034424a64918a43ca2b961aa2063` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:27.837109 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8d034424a64918a43ca2b961aa2063)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:27.839028 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:27.968154 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8d034424a64918a43ca2b961aa2063', 'request_id': 'req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:27.975865 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8d034424a64918a43ca2b961aa2063', 'request_id': 'req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.062661 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8d034424a64918a43ca2b961aa2063', 'request_id': 'req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.074824 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] The token cache is being invalidate because project dc8d034424a64918a43ca2b961aa2063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:28.081351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.081351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.081351 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1441/2901] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:27 2022] DELETE /identity/v3/projects/dc8d034424a64918a43ca2b961aa2063 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:28.082434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:28.083978 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:28.097437 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01365349-7660-462d-a8a0-d97bc9c507be admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:28.157442 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:28.158080 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:28.158389 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:28.158661 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] PATH_INFO: `/v3/users/9ab0f16c96644a92acc3bb3b4b0da708` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:28.159799 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab0f16c96644a92acc3bb3b4b0da708)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:28.161748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:28.362748 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab0f16c96644a92acc3bb3b4b0da708'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.363797 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:28.375117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab0f16c96644a92acc3bb3b4b0da708'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.444583 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab0f16c96644a92acc3bb3b4b0da708'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.445522 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab0f16c96644a92acc3bb3b4b0da708'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.446161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab0f16c96644a92acc3bb3b4b0da708'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.460422 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1461/2902] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:28 2022] DELETE /identity/v3/users/9ab0f16c96644a92acc3bb3b4b0da708 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:28.727139 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:28.728667 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:28.742773 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db339-b6f1-4d7b-99fe-83a5aca4d149 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:28.773260 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:28.802100 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:28.802839 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:28.803116 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:28.803477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] PATH_INFO: `/v3/projects/bb2a5d887b724b15b9dab865064a84b2` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:28.804666 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2a5d887b724b15b9dab865064a84b2)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:28.806717 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:28.890579 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2a5d887b724b15b9dab865064a84b2', 'request_id': 'req-472f2dcf-95d3-4e6e-bb58-5cb727331219'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.896711 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2a5d887b724b15b9dab865064a84b2', 'request_id': 'req-472f2dcf-95d3-4e6e-bb58-5cb727331219'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.953361 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2a5d887b724b15b9dab865064a84b2', 'request_id': 'req-472f2dcf-95d3-4e6e-bb58-5cb727331219'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.964252 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] The token cache is being invalidate because project bb2a5d887b724b15b9dab865064a84b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81881) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:28.964535 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.965143 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:28.967013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1442/2903] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:28 2022] DELETE /identity/v3/projects/bb2a5d887b724b15b9dab865064a84b2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 13:02:30.263544 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:30.265093 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:30.325297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365578-0ed2-4edb-bd75-8286627ae9c5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:30.376883 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17858a6841b14bc2bca713bbad4cc5c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:30.377395 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:30.378261 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:30.378535 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:30.380297 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:30.442760 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:30.444192 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:30.453727 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1462/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 13:02:37.702991 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:37.704454 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:37.719436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f2dcf-95d3-4e6e-bb58-5cb727331219 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:37.723206 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:37.723835 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:37.724113 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:37.724384 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] PATH_INFO: `/v3/users/35306cf75bde4fdcbb1374fa9ab82aa7` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:37.725502 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35306cf75bde4fdcbb1374fa9ab82aa7)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:37.727436 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:37.878065 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35306cf75bde4fdcbb1374fa9ab82aa7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:37.879026 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35306cf75bde4fdcbb1374fa9ab82aa7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:37.892257 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35306cf75bde4fdcbb1374fa9ab82aa7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:37.930901 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35306cf75bde4fdcbb1374fa9ab82aa7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:37.931536 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35306cf75bde4fdcbb1374fa9ab82aa7'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:37.944806 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1443/2905] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:37 2022] DELETE /identity/v3/users/35306cf75bde4fdcbb1374fa9ab82aa7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:38.211982 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:38.222550 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b387-41df-448b-a3cc-7bdc90315ce0 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:38.255161 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:38.283276 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:38.283937 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:38.284212 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:38.284480 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] PATH_INFO: `/v3/projects/66ab7e2f4bbd43f4a795a5f1068a32f9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:38.285597 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ab7e2f4bbd43f4a795a5f1068a32f9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:38.287516 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:38.416644 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'request_id': 'req-e9d909c8-d427-4632-a13b-615fd5cbf526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.496053 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'request_id': 'req-e9d909c8-d427-4632-a13b-615fd5cbf526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.502641 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ab7e2f4bbd43f4a795a5f1068a32f9', 'request_id': 'req-e9d909c8-d427-4632-a13b-615fd5cbf526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.513245 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] The token cache is being invalidate because project 66ab7e2f4bbd43f4a795a5f1068a32f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:38.513527 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.514144 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.515704 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1463/2906] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:38 2022] DELETE /identity/v3/projects/66ab7e2f4bbd43f4a795a5f1068a32f9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:38.519789 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:38.521171 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:38.535174 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c7194-2dfe-4d41-8675-916c8b50dc25 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:38.565178 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:38.590592 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:38.591204 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:38.591477 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:38.591742 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] PATH_INFO: `/v3/users/1ae3547921954c0ca0a4c47b72e63fa5` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:38.592849 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae3547921954c0ca0a4c47b72e63fa5)` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:38.594775 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:38.806013 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae3547921954c0ca0a4c47b72e63fa5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.806728 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae3547921954c0ca0a4c47b72e63fa5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.818616 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae3547921954c0ca0a4c47b72e63fa5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.889155 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae3547921954c0ca0a4c47b72e63fa5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.889787 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.notifications [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae3547921954c0ca0a4c47b72e63fa5'} {{(pid=81881) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:38.902599 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1444/2907] 10.222.0.15 () {58 vars in 1224 bytes} [Mon Aug 22 13:02:38 2022] DELETE /identity/v3/users/1ae3547921954c0ca0a4c47b72e63fa5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:39.183879 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:02:39.187653 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:02:39.199792 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d909c8-d427-4632-a13b-615fd5cbf526 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:02:39.261114 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb451a0ed5164dd0a6301058cedf4d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2da9e1885c75493abe2144dd979376b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:02:39.261772 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:02:39.262006 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:02:39.262322 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] PATH_INFO: `/v3/projects/7dd55124e6124098a528a19cd4d2ea80` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:02:39.263460 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd55124e6124098a528a19cd4d2ea80)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:02:39.265371 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:02:39.370083 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd55124e6124098a528a19cd4d2ea80', 'request_id': 'req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:39.449988 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd55124e6124098a528a19cd4d2ea80', 'request_id': 'req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:39.457434 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd55124e6124098a528a19cd4d2ea80', 'request_id': 'req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:39.459487 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:39.468117 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] The token cache is being invalidate because project 7dd55124e6124098a528a19cd4d2ea80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 13:02:39.468405 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:39.469036 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a7b8dfa4-b08c-481e-988d-f2ba38ea59bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 13:02:39.470585 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1464/2908] 10.222.0.15 () {58 vars in 1233 bytes} [Mon Aug 22 13:02:39 2022] DELETE /identity/v3/projects/7dd55124e6124098a528a19cd4d2ea80 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 13:02:48.899137 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:02:49.587600 dv-cinder-850836-6-iscsi devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 13:06:22.408333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Authenticating user token {{(pid=81881) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 13:06:22.409719 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:06:22.546438 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b34b1f-51ae-4b64-a8ef-e981c584d622 admin admin] Validating token access rules against request {{(pid=81881) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 13:06:22.603168 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2887cf82974425388d18660bf964fa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dc7b26e6af4baba62dc8470e2fd706', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81881) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 13:06:22.603765 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] REQUEST_METHOD: `GET` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 13:06:22.604047 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] SCRIPT_NAME: `/identity` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 13:06:22.604318 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81881) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 13:06:22.606003 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.fernet_utils [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81881) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 13:06:22.617182 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 13:06:22.618771 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b738a8b-51b0-4367-b024-1fe2617939be service placement] RBAC: Authorization granted {{(pid=81881) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 13:06:22.628474 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: [pid: 81881|app: 0|req: 1445/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Aug 22 13:06:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 13:06:32.624333 dv-cinder-850836-6-iscsi devstack@keystone.service[81881]: DEBUG dbcounter [-] [81881] Writing DB stats keystone:SELECT=89 {{(pid=81881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}